Multi-modal multi-task learning for joint prediction of clinical scores in Alzheimer's disease

Daoqiang Zhang, Dinggang Shen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

One recent interest in computer-aided diagnosis of neurological diseases is to predict the clinical scores from brain images. Most existing methods usually estimate multiple clinical variables separately, without considering the useful correlation information among them. On the other hand, nearly all methods use only one modality of data (mostly structural MRI) for regression, and thus ignore the complementary information among different modalities. To address these issues, in this paper, we present a general methodology, namely Multi-Modal Multi-Task (M3T) learning, to jointly predict multiple variables from multi-modal data. Our method contains three major subsequent steps: (1) a multi-task feature selection which selects the common subset of relevant features for the related multiple clinical variables from each modality; (2) a kernel-based multimodal data fusion which fuses the above-selected features from all modalities; (3) a support vector regression which predicts multiple clinical variables based on the previously learnt mixed kernel. Experimental results on ADNI dataset with both imaging modalities (MRI and PET) and biological modality (CSF) validate the efficacy of the proposed M3T learning method.

Original languageEnglish
Title of host publicationMultimodal Brain Image Analysis - First International Workshop, MBIA 2011, Held in Conjunction with MICCAI 2011, Proceedings
Pages60-67
Number of pages8
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event1st International Workshop on Multimodal Brain Image Analysis, MBIA 2011, in Conjunction with the 14th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2011 - Toronto, ON, Canada
Duration: 2011 Sep 182011 Sep 18

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7012 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st International Workshop on Multimodal Brain Image Analysis, MBIA 2011, in Conjunction with the 14th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2011
CountryCanada
CityToronto, ON
Period11/9/1811/9/18

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Multi-modal multi-task learning for joint prediction of clinical scores in Alzheimer's disease'. Together they form a unique fingerprint.

Cite this