TY - JOUR
T1 - Leveraging Coupled Interaction for Multimodal Alzheimer's Disease Diagnosis
AU - Shi, Yinghuan
AU - Suk, Heung Il
AU - Gao, Yang
AU - Lee, Seong Whan
AU - Shen, Dinggang
N1 - Funding Information:
Manuscript received June 19, 2018; revised October 7, 2018, January 30, 2019, and February 13, 2019; accepted February 14, 2019. Date of publication March 20, 2019; date of current version January 3, 2020. The work of Y. Shi and Y. Gao was supported in part by Natural Science Foundation of China under Grant 61673203 and Grant 61432008, in part by the Young Elite Scientists Sponsorship Program China Association for Science and Technology under Grant YESS 2016QNRC001, and in part by the China Computer Federation-Tencent Open Research Fund under Grant RAGR 20180114. The work of D. Shen was supported in part by the National Institute of Health under Grant EB022880, Grant AG053867, Grant EB008374, and Grant AG041721. The works of H.-I. Suk and S.-W. Lee were supported in part by the Institute of Information and Communications Technology Planning and Evaluation Grant through the Korea Government under Grant 2017-0-00451. (Corresponding authors: Yang Gao; Dinggang Shen.) Y. Shi and Y. Gao are with the State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing 210008, China (e-mail: syh@nju.edu.cn; gaoy@nju.edu.cn).
Funding Information:
The work of Y. Shi and Y. Gao was supported in part by Natural Science Foundation of China under Grant 61673203 and Grant 61432008, in part by the Young Elite Scientists Sponsorship Program China Association for Science and Technology under Grant YESS 2016QNRC001, and in part by the China Computer Federation-Tencent Open Research Fund under Grant RAGR 20180114. The work of D. Shen was supported in part by the National Institute of Health under Grant EB022880, Grant AG053867, Grant EB008374, and Grant AG041721. The works of H.-I. Suk and S.-W. Lee were supported in part by the Institute of Information and Communications Technology Planning and Evaluation Grant through the Korea Government under Grant 2017-0-00451.
Publisher Copyright:
© 2012 IEEE.
PY - 2020/1
Y1 - 2020/1
N2 - As the population becomes older worldwide, accurate computer-aided diagnosis for Alzheimer's disease (AD) in the early stage has been regarded as a crucial step for neurodegeneration care in recent years. Since it extracts the low-level features from the neuroimaging data, previous methods regarded this computer-aided diagnosis as a classification problem that ignored latent featurewise relation. However, it is known that multiple brain regions in the human brain are anatomically and functionally interlinked according to the current neuroscience perspective. Thus, it is reasonable to assume that the extracted features from different brain regions are related to each other to some extent. Also, the complementary information between different neuroimaging modalities could benefit multimodal fusion. To this end, we consider leveraging the coupled interactions in the feature level and modality level for diagnosis in this paper. First, we propose capturing the feature-level coupled interaction using a coupled feature representation. Then, to model the modality-level coupled interaction, we present two novel methods: 1) the coupled boosting (CB) that models the correlation of pairwise coupled-diversity on both inconsistently and incorrectly classified samples between different modalities and 2) the coupled metric ensemble (CME) that learns an informative feature projection from different modalities by integrating the intrarelation and interrelation of training samples. We systematically evaluated our methods with the AD neuroimaging initiative data set. By comparison with the baseline learning-based methods and the state-of-the-art methods that are specially developed for AD/MCI (mild cognitive impairment) diagnosis, our methods achieved the best performance with accuracy of 95.0% and 80.7% (CB), 94.9% and 79.9% (CME) for AD/NC (normal control), and MCI/NC identification, respectively.
AB - As the population becomes older worldwide, accurate computer-aided diagnosis for Alzheimer's disease (AD) in the early stage has been regarded as a crucial step for neurodegeneration care in recent years. Since it extracts the low-level features from the neuroimaging data, previous methods regarded this computer-aided diagnosis as a classification problem that ignored latent featurewise relation. However, it is known that multiple brain regions in the human brain are anatomically and functionally interlinked according to the current neuroscience perspective. Thus, it is reasonable to assume that the extracted features from different brain regions are related to each other to some extent. Also, the complementary information between different neuroimaging modalities could benefit multimodal fusion. To this end, we consider leveraging the coupled interactions in the feature level and modality level for diagnosis in this paper. First, we propose capturing the feature-level coupled interaction using a coupled feature representation. Then, to model the modality-level coupled interaction, we present two novel methods: 1) the coupled boosting (CB) that models the correlation of pairwise coupled-diversity on both inconsistently and incorrectly classified samples between different modalities and 2) the coupled metric ensemble (CME) that learns an informative feature projection from different modalities by integrating the intrarelation and interrelation of training samples. We systematically evaluated our methods with the AD neuroimaging initiative data set. By comparison with the baseline learning-based methods and the state-of-the-art methods that are specially developed for AD/MCI (mild cognitive impairment) diagnosis, our methods achieved the best performance with accuracy of 95.0% and 80.7% (CB), 94.9% and 79.9% (CME) for AD/NC (normal control), and MCI/NC identification, respectively.
KW - Computer-aided AD/MCI diagnosis
KW - coupled boosting (CB)
KW - coupled feature (CFR) representation
KW - coupled metric ensemble (CME)
UR - http://www.scopus.com/inward/record.url?scp=85068843452&partnerID=8YFLogxK
U2 - 10.1109/TNNLS.2019.2900077
DO - 10.1109/TNNLS.2019.2900077
M3 - Article
C2 - 30908241
AN - SCOPUS:85068843452
VL - 31
SP - 186
EP - 200
JO - IEEE Transactions on Neural Networks and Learning Systems
JF - IEEE Transactions on Neural Networks and Learning Systems
SN - 2162-237X
IS - 1
M1 - 8672088
ER -