3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients

Dong Nie, Han Zhang, Ehsan Adeli, Luyan Liu, Dinggang Shen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

76 Citations (Scopus)

Abstract

High-grade glioma is the most aggressive and severe brain tumor that leads to death of almost 50% patients in 1–2 years. Thus,accurate prognosis for glioma patients would provide essential guidelines for their treatment planning. Conventional survival prediction generally utilizes clinical information and limited handcrafted features from magnetic resonance images (MRI),which is often time consuming,laborious and subjective. In this paper,we propose using deep learning frameworks to automatically extract features from multi-modal preoperative brain images (i.e.,T1 MRI,fMRI and DTI) of high-grade glioma patients. Specifically,we adopt 3D convolutional neural networks (CNNs) and also propose a new network architecture for using multi-channel data and learning supervised features. Along with the pivotal clinical features,we finally train a support vector machine to predict if the patient has a long or short overall survival (OS) time. Experimental results demonstrate that our methods can achieve an accuracy as high as 89.9% We also find that the learned features from fMRI and DTI play more important roles in accurately predicting the OS time,which provides valuable insights into functional neuro-oncological applications.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings
PublisherSpringer Verlag
Pages212-220
Number of pages9
Volume9901 LNCS
ISBN (Print)9783319467221
DOIs
Publication statusPublished - 2016
Externally publishedYes

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9901 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of '3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients'. Together they form a unique fingerprint.

  • Cite this

    Nie, D., Zhang, H., Adeli, E., Liu, L., & Shen, D. (2016). 3D deep learning for multi-modal imaging-guided survival time prediction of brain tumor patients. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings (Vol. 9901 LNCS, pp. 212-220). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9901 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-46723-8_25