Multi-class classification via heterogeneous ensemble of one-class classifiers

Seokho Kang, Sungzoon Cho, Pilsung Kang

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

In this paper, a multi-class classification method based on heterogeneous ensemble of one-class classifiers is proposed. The proposed method consists of two phases: training heterogeneous one-class classifiers for each class using various one-class classification algorithms, and constructing an ensemble by combining the base classifiers using multi-response linear regression-based stacking. The use of various classification algorithms contributes towards increasing the diversity of the ensemble, while stacking resolves the normalization issues on different scales of outputs obtained from the base classifiers. In addition, we also demonstrate the selective utilization of base classifiers by adopting a stepwise variable selection procedure during stacking. Through our experiments on multi-class benchmark datasets, we concluded that our proposed method outperforms the methods that are based on single one-class classification algorithms with statistical significance.

Original languageEnglish
Pages (from-to)35-43
Number of pages9
JournalEngineering Applications of Artificial Intelligence
Volume43
DOIs
Publication statusPublished - 2015 Aug 1

Fingerprint

Classifiers
Linear regression
Experiments

Keywords

  • Ensemble
  • Heterogeneous ensemble
  • Meta-learning
  • Multi-class classification
  • One-class classification
  • Stacking

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Multi-class classification via heterogeneous ensemble of one-class classifiers. / Kang, Seokho; Cho, Sungzoon; Kang, Pilsung.

In: Engineering Applications of Artificial Intelligence, Vol. 43, 01.08.2015, p. 35-43.

Research output: Contribution to journalArticle

@article{fbcf2de55b5643c28b4e5d0859840346,
title = "Multi-class classification via heterogeneous ensemble of one-class classifiers",
abstract = "In this paper, a multi-class classification method based on heterogeneous ensemble of one-class classifiers is proposed. The proposed method consists of two phases: training heterogeneous one-class classifiers for each class using various one-class classification algorithms, and constructing an ensemble by combining the base classifiers using multi-response linear regression-based stacking. The use of various classification algorithms contributes towards increasing the diversity of the ensemble, while stacking resolves the normalization issues on different scales of outputs obtained from the base classifiers. In addition, we also demonstrate the selective utilization of base classifiers by adopting a stepwise variable selection procedure during stacking. Through our experiments on multi-class benchmark datasets, we concluded that our proposed method outperforms the methods that are based on single one-class classification algorithms with statistical significance.",
keywords = "Ensemble, Heterogeneous ensemble, Meta-learning, Multi-class classification, One-class classification, Stacking",
author = "Seokho Kang and Sungzoon Cho and Pilsung Kang",
year = "2015",
month = "8",
day = "1",
doi = "10.1016/j.engappai.2015.04.003",
language = "English",
volume = "43",
pages = "35--43",
journal = "Engineering Applications of Artificial Intelligence",
issn = "0952-1976",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Multi-class classification via heterogeneous ensemble of one-class classifiers

AU - Kang, Seokho

AU - Cho, Sungzoon

AU - Kang, Pilsung

PY - 2015/8/1

Y1 - 2015/8/1

N2 - In this paper, a multi-class classification method based on heterogeneous ensemble of one-class classifiers is proposed. The proposed method consists of two phases: training heterogeneous one-class classifiers for each class using various one-class classification algorithms, and constructing an ensemble by combining the base classifiers using multi-response linear regression-based stacking. The use of various classification algorithms contributes towards increasing the diversity of the ensemble, while stacking resolves the normalization issues on different scales of outputs obtained from the base classifiers. In addition, we also demonstrate the selective utilization of base classifiers by adopting a stepwise variable selection procedure during stacking. Through our experiments on multi-class benchmark datasets, we concluded that our proposed method outperforms the methods that are based on single one-class classification algorithms with statistical significance.

AB - In this paper, a multi-class classification method based on heterogeneous ensemble of one-class classifiers is proposed. The proposed method consists of two phases: training heterogeneous one-class classifiers for each class using various one-class classification algorithms, and constructing an ensemble by combining the base classifiers using multi-response linear regression-based stacking. The use of various classification algorithms contributes towards increasing the diversity of the ensemble, while stacking resolves the normalization issues on different scales of outputs obtained from the base classifiers. In addition, we also demonstrate the selective utilization of base classifiers by adopting a stepwise variable selection procedure during stacking. Through our experiments on multi-class benchmark datasets, we concluded that our proposed method outperforms the methods that are based on single one-class classification algorithms with statistical significance.

KW - Ensemble

KW - Heterogeneous ensemble

KW - Meta-learning

KW - Multi-class classification

KW - One-class classification

KW - Stacking

UR - http://www.scopus.com/inward/record.url?scp=84929871599&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929871599&partnerID=8YFLogxK

U2 - 10.1016/j.engappai.2015.04.003

DO - 10.1016/j.engappai.2015.04.003

M3 - Article

AN - SCOPUS:84929871599

VL - 43

SP - 35

EP - 43

JO - Engineering Applications of Artificial Intelligence

JF - Engineering Applications of Artificial Intelligence

SN - 0952-1976

ER -