An introduction to kernel-based learning algorithms

Klaus Robert Müller; Sebastian Mika; Gunnar Rätsch; Koji Tsuda; Bernhard Schölkopf

doi:10.1109/72.914517

An introduction to kernel-based learning algorithms

Klaus Robert Müller, Sebastian Mika, Gunnar Rätsch, Koji Tsuda, Bernhard Schölkopf

Research output: Contribution to journal › Review article › peer-review

2900 Citations (Scopus)

Abstract

This paper provides an introduction to support vector machines (SVMs), kernel Fisher discriminant analysis, and kernel principal component analysis (PCA), as examples for successful kernel-based learning methods. We first give a short background about Vapnik-Chervonenkis (VC) theory and kernel feature spaces and then proceed to kernel based learning in supervised and unsupervised scenarios including practical and algorithmic considerations. We illustrate the usefulness of kernel algorithms by finally discussing applications such as optical character recognition (OCR) and DNA analysis.

Original language	English
Pages (from-to)	181-201
Number of pages	21
Journal	IEEE Transactions on Neural Networks
Volume	12
Issue number	2
DOIs	https://doi.org/10.1109/72.914517
Publication status	Published - 2001 Mar

Keywords

Boosting
Fisher's discriminant
Kernel PCA
Kernel methods
Mathematical programming machines
Mercer kernels
Principal component analysis (PCA)
Single-class classification
Support vector machines (SVMs)

ASJC Scopus subject areas

Software
Computer Science Applications
Computer Networks and Communications
Artificial Intelligence

Access to Document

10.1109/72.914517

Cite this

@article{abb89fb491fb4590b1ea0cfa4ea89f2b,

title = "An introduction to kernel-based learning algorithms",

abstract = "This paper provides an introduction to support vector machines (SVMs), kernel Fisher discriminant analysis, and kernel principal component analysis (PCA), as examples for successful kernel-based learning methods. We first give a short background about Vapnik-Chervonenkis (VC) theory and kernel feature spaces and then proceed to kernel based learning in supervised and unsupervised scenarios including practical and algorithmic considerations. We illustrate the usefulness of kernel algorithms by finally discussing applications such as optical character recognition (OCR) and DNA analysis.",

keywords = "Boosting, Fisher's discriminant, Kernel PCA, Kernel methods, Mathematical programming machines, Mercer kernels, Principal component analysis (PCA), Single-class classification, Support vector machines (SVMs)",

author = "M{\"u}ller, {Klaus Robert} and Sebastian Mika and Gunnar R{\"a}tsch and Koji Tsuda and Bernhard Sch{\"o}lkopf",

note = "Funding Information: Manuscript received August 10, 2000; revised December 15, 2000. This work was supported by DFG (JA 379/9-1, MU 987/1-1), EU (IST-1999-14190-BLISS), and travel grants from DAAD, NSF, and EU (Neurocolt II).",

year = "2001",

month = mar,

doi = "10.1109/72.914517",

language = "English",

volume = "12",

pages = "181--201",

journal = "IEEE Transactions on Neural Networks and Learning Systems",

issn = "2162-237X",

publisher = "IEEE Computational Intelligence Society",

number = "2",

}

TY - JOUR

T1 - An introduction to kernel-based learning algorithms

AU - Müller, Klaus Robert

AU - Mika, Sebastian

AU - Rätsch, Gunnar

AU - Tsuda, Koji

AU - Schölkopf, Bernhard

N1 - Funding Information: Manuscript received August 10, 2000; revised December 15, 2000. This work was supported by DFG (JA 379/9-1, MU 987/1-1), EU (IST-1999-14190-BLISS), and travel grants from DAAD, NSF, and EU (Neurocolt II).

PY - 2001/3

Y1 - 2001/3

N2 - This paper provides an introduction to support vector machines (SVMs), kernel Fisher discriminant analysis, and kernel principal component analysis (PCA), as examples for successful kernel-based learning methods. We first give a short background about Vapnik-Chervonenkis (VC) theory and kernel feature spaces and then proceed to kernel based learning in supervised and unsupervised scenarios including practical and algorithmic considerations. We illustrate the usefulness of kernel algorithms by finally discussing applications such as optical character recognition (OCR) and DNA analysis.

AB - This paper provides an introduction to support vector machines (SVMs), kernel Fisher discriminant analysis, and kernel principal component analysis (PCA), as examples for successful kernel-based learning methods. We first give a short background about Vapnik-Chervonenkis (VC) theory and kernel feature spaces and then proceed to kernel based learning in supervised and unsupervised scenarios including practical and algorithmic considerations. We illustrate the usefulness of kernel algorithms by finally discussing applications such as optical character recognition (OCR) and DNA analysis.

KW - Boosting

KW - Fisher's discriminant

KW - Kernel PCA

KW - Kernel methods

KW - Mathematical programming machines

KW - Mercer kernels

KW - Principal component analysis (PCA)

KW - Single-class classification

KW - Support vector machines (SVMs)

UR - http://www.scopus.com/inward/record.url?scp=0035272287&partnerID=8YFLogxK

U2 - 10.1109/72.914517

DO - 10.1109/72.914517

M3 - Review article

C2 - 18244377

AN - SCOPUS:0035272287

VL - 12

SP - 181

EP - 201

JO - IEEE Transactions on Neural Networks and Learning Systems

JF - IEEE Transactions on Neural Networks and Learning Systems

SN - 2162-237X

IS - 2

ER -

An introduction to kernel-based learning algorithms

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this