A new discriminative kernel from probabilistic models

K. Tsuda, M. Kawanabe, G. Ratsch, S. Sonnenburg, Klaus Muller

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Recently. Jaakkola and Haussler proposed a method for constructing kernel functions from probabilistic models. Their so called "Fisher kernel" has been combined with discriminative classifiers such as SVM and applied successfully in e.g. DNA and protein analysis. Whereas the Fisher kernel (FK) is calculated from the marginal log-likelihood, we propose the TOP kernel derived from Tangent vectors Of Posterior log-odds. Furthermore we develop a theoretical framework on feature extractors from probabilistic models and use it for analyzing FK and TOP. In experiments our new discriminative TOP kernel compares favorably to the Fisher kernel.

Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems
PublisherNeural information processing systems foundation
ISBN (Print)0262042088, 9780262042086
Publication statusPublished - 2002 Jan 1
Externally publishedYes
Event15th Annual Neural Information Processing Systems Conference, NIPS 2001 - Vancouver, BC, Canada
Duration: 2001 Dec 32001 Dec 8

Other

Other15th Annual Neural Information Processing Systems Conference, NIPS 2001
CountryCanada
CityVancouver, BC
Period01/12/301/12/8

Fingerprint

DNA
Classifiers
Proteins
Experiments
Statistical Models

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing

Cite this

Tsuda, K., Kawanabe, M., Ratsch, G., Sonnenburg, S., & Muller, K. (2002). A new discriminative kernel from probabilistic models. In Advances in Neural Information Processing Systems Neural information processing systems foundation.

A new discriminative kernel from probabilistic models. / Tsuda, K.; Kawanabe, M.; Ratsch, G.; Sonnenburg, S.; Muller, Klaus.

Advances in Neural Information Processing Systems. Neural information processing systems foundation, 2002.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tsuda, K, Kawanabe, M, Ratsch, G, Sonnenburg, S & Muller, K 2002, A new discriminative kernel from probabilistic models. in Advances in Neural Information Processing Systems. Neural information processing systems foundation, 15th Annual Neural Information Processing Systems Conference, NIPS 2001, Vancouver, BC, Canada, 01/12/3.
Tsuda K, Kawanabe M, Ratsch G, Sonnenburg S, Muller K. A new discriminative kernel from probabilistic models. In Advances in Neural Information Processing Systems. Neural information processing systems foundation. 2002
Tsuda, K. ; Kawanabe, M. ; Ratsch, G. ; Sonnenburg, S. ; Muller, Klaus. / A new discriminative kernel from probabilistic models. Advances in Neural Information Processing Systems. Neural information processing systems foundation, 2002.
@inproceedings{e98f27e22e4a4e14bf2adb82569553b0,
title = "A new discriminative kernel from probabilistic models",
abstract = "Recently. Jaakkola and Haussler proposed a method for constructing kernel functions from probabilistic models. Their so called {"}Fisher kernel{"} has been combined with discriminative classifiers such as SVM and applied successfully in e.g. DNA and protein analysis. Whereas the Fisher kernel (FK) is calculated from the marginal log-likelihood, we propose the TOP kernel derived from Tangent vectors Of Posterior log-odds. Furthermore we develop a theoretical framework on feature extractors from probabilistic models and use it for analyzing FK and TOP. In experiments our new discriminative TOP kernel compares favorably to the Fisher kernel.",
author = "K. Tsuda and M. Kawanabe and G. Ratsch and S. Sonnenburg and Klaus Muller",
year = "2002",
month = "1",
day = "1",
language = "English",
isbn = "0262042088",
booktitle = "Advances in Neural Information Processing Systems",
publisher = "Neural information processing systems foundation",

}

TY - GEN

T1 - A new discriminative kernel from probabilistic models

AU - Tsuda, K.

AU - Kawanabe, M.

AU - Ratsch, G.

AU - Sonnenburg, S.

AU - Muller, Klaus

PY - 2002/1/1

Y1 - 2002/1/1

N2 - Recently. Jaakkola and Haussler proposed a method for constructing kernel functions from probabilistic models. Their so called "Fisher kernel" has been combined with discriminative classifiers such as SVM and applied successfully in e.g. DNA and protein analysis. Whereas the Fisher kernel (FK) is calculated from the marginal log-likelihood, we propose the TOP kernel derived from Tangent vectors Of Posterior log-odds. Furthermore we develop a theoretical framework on feature extractors from probabilistic models and use it for analyzing FK and TOP. In experiments our new discriminative TOP kernel compares favorably to the Fisher kernel.

AB - Recently. Jaakkola and Haussler proposed a method for constructing kernel functions from probabilistic models. Their so called "Fisher kernel" has been combined with discriminative classifiers such as SVM and applied successfully in e.g. DNA and protein analysis. Whereas the Fisher kernel (FK) is calculated from the marginal log-likelihood, we propose the TOP kernel derived from Tangent vectors Of Posterior log-odds. Furthermore we develop a theoretical framework on feature extractors from probabilistic models and use it for analyzing FK and TOP. In experiments our new discriminative TOP kernel compares favorably to the Fisher kernel.

UR - http://www.scopus.com/inward/record.url?scp=84899032930&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899032930&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84899032930

SN - 0262042088

SN - 9780262042086

BT - Advances in Neural Information Processing Systems

PB - Neural information processing systems foundation

ER -