On-line learning in changing environments with applications in supervised and unsupervised learning

Noboru Murata, Motoaki Kawanabe, Andreas Ziehe, Klaus Muller, Shun Ichi Amari

Research output: Contribution to journalArticle

41 Citations (Scopus)


An adaptive on-line algorithm extending the learning of learning idea is proposed and theoretically motivated. Relying only on gradient flow information it can be applied to learning continuous functions or distributions, even when no explicit loss function is given and the Hessian is not available. The framework is applied for unsupervised and supervised learning. Its efficiency is demonstrated for drifting and switching non-stationary blind separation tasks of acoustic signals. Furthermore applications to classification (US postal service data set) and time-series prediction in changing environments are presented.

Original languageEnglish
Pages (from-to)743-760
Number of pages18
JournalNeural Networks
Issue number4-6
Publication statusPublished - 2002 Jun 1
Externally publishedYes



  • Adaptive learning rate
  • Blind source separation
  • ICA
  • On-line learning
  • Stochastic gradient descent
  • Supervised learning
  • Unsupervised learning

ASJC Scopus subject areas

  • Artificial Intelligence
  • Neuroscience(all)

Cite this