Spherical U-Net on Cortical Surfaces: Methods and Applications

Fenqiang Zhao, Shunren Xia, Zhengwang Wu, Dingna Duan, Li Wang, Weili Lin, John H. Gilmore, Dinggang Shen, Gang Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have a spherical topology in a manifold space, e.g., brain cortical or subcortical surfaces represented by triangular meshes, with large inter-subject and intra-subject variations in vertex number and local connectivity. Hence, there is no consistent neighborhood definition and thus no straightforward convolution/transposed convolution operations for cortical/subcortical surface data. In this paper, by leveraging the regular and consistent geometric structure of the resampled cortical surface mapped onto the spherical space, we propose a novel convolution filter analogous to the standard convolution on the image grid. Accordingly, we develop corresponding operations for convolution, pooling, and transposed convolution for spherical surface data and thus construct spherical CNNs. Specifically, we propose the Spherical U-Net architecture by replacing all operations in the standard U-Net with their spherical operation counterparts. We then apply the Spherical U-Net to two challenging and neuroscientifically important tasks in infant brains: cortical surface parcellation and cortical attribute map development prediction. Both applications demonstrate the competitive performance in the accuracy, computational efficiency, and effectiveness of our proposed Spherical U-Net, in comparison with the state-of-the-art methods.

Original languageEnglish
Title of host publicationInformation Processing in Medical Imaging - 26th International Conference, IPMI 2019, Proceedings
EditorsSiqi Bao, Albert C.S. Chung, James C. Gee, Paul A. Yushkevich
PublisherSpringer Verlag
Pages855-866
Number of pages12
ISBN (Print)9783030203504
DOIs
Publication statusPublished - 2019 Jan 1
Externally publishedYes
Event26th International Conference on Information Processing in Medical Imaging, IPMI 2019 - Hong Kong, China
Duration: 2019 Jun 22019 Jun 7

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11492 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference26th International Conference on Information Processing in Medical Imaging, IPMI 2019
CountryChina
CityHong Kong
Period19/6/219/6/7

Keywords

  • Convolutional Neural Network
  • Cortical surface
  • Parcellation
  • Prediction
  • Spherical U-Net

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Spherical U-Net on Cortical Surfaces: Methods and Applications'. Together they form a unique fingerprint.

  • Cite this

    Zhao, F., Xia, S., Wu, Z., Duan, D., Wang, L., Lin, W., Gilmore, J. H., Shen, D., & Li, G. (2019). Spherical U-Net on Cortical Surfaces: Methods and Applications. In S. Bao, A. C. S. Chung, J. C. Gee, & P. A. Yushkevich (Eds.), Information Processing in Medical Imaging - 26th International Conference, IPMI 2019, Proceedings (pp. 855-866). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11492 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-20351-1_67