Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks

Jun Zhang, Mingxia Liu, Li Wang, Si Chen, Peng Yuan, Jianfu Li, Steve Guo Fang Shen, Zhen Tang, Ken Chung Chen, James J. Xia, Dinggang Shen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

Generating accurate 3D models from cone-beam computed tomography (CBCT) images is an important step in developing treatment plans for patients with craniomaxillofacial (CMF) deformities. This process often involves bone segmentation and landmark digitization. Since anatomical landmarks generally lie on the boundaries of segmented bone regions, the tasks of bone segmentation and landmark digitization could be highly correlated. However, most existing methods simply treat them as two standalone tasks, without considering their inherent association. In addition, these methods usually ignore the spatial context information (i.e., displacements from voxels to landmarks) in CBCT images. To this end, we propose a context-guided fully convolutional network (FCN) for joint bone segmentation and landmark digitization. Specifically, we first train an FCN to learn the displacement maps to capture the spatial context information in CBCT images. Using the learned displacement maps as guidance information, we further develop a multi-task FCN to jointly perform bone segmentation and landmark digitization. Our method has been evaluated on 107 subjects from two centers, and the experimental results show that our method is superior to the state-of-the-art methods in both bone segmentation and landmark digitization.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings
PublisherSpringer Verlag
Pages720-728
Number of pages9
Volume10434 LNCS
ISBN (Print)9783319661841
DOIs
Publication statusPublished - 2017
Externally publishedYes
Event20th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2017 - Quebec City, Canada
Duration: 2017 Sep 112017 Sep 13

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10434 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other20th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2017
CountryCanada
CityQuebec City
Period17/9/1117/9/13

Fingerprint

Digitization
Analog to digital conversion
Landmarks
Bone
Segmentation
Computed Tomography
Tomography
Cones
Cone
Addition method
Voxel
Context
3D Model
Guidance
Experimental Results

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Zhang, J., Liu, M., Wang, L., Chen, S., Yuan, P., Li, J., ... Shen, D. (2017). Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks. In Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings (Vol. 10434 LNCS, pp. 720-728). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10434 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-66185-8_81

Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks. / Zhang, Jun; Liu, Mingxia; Wang, Li; Chen, Si; Yuan, Peng; Li, Jianfu; Shen, Steve Guo Fang; Tang, Zhen; Chen, Ken Chung; Xia, James J.; Shen, Dinggang.

Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings. Vol. 10434 LNCS Springer Verlag, 2017. p. 720-728 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10434 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhang, J, Liu, M, Wang, L, Chen, S, Yuan, P, Li, J, Shen, SGF, Tang, Z, Chen, KC, Xia, JJ & Shen, D 2017, Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks. in Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings. vol. 10434 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10434 LNCS, Springer Verlag, pp. 720-728, 20th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2017, Quebec City, Canada, 17/9/11. https://doi.org/10.1007/978-3-319-66185-8_81
Zhang J, Liu M, Wang L, Chen S, Yuan P, Li J et al. Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks. In Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings. Vol. 10434 LNCS. Springer Verlag. 2017. p. 720-728. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-66185-8_81
Zhang, Jun ; Liu, Mingxia ; Wang, Li ; Chen, Si ; Yuan, Peng ; Li, Jianfu ; Shen, Steve Guo Fang ; Tang, Zhen ; Chen, Ken Chung ; Xia, James J. ; Shen, Dinggang. / Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks. Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings. Vol. 10434 LNCS Springer Verlag, 2017. pp. 720-728 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{0585988fc9fe4ad5abfe2b96a1cccdba,
title = "Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks",
abstract = "Generating accurate 3D models from cone-beam computed tomography (CBCT) images is an important step in developing treatment plans for patients with craniomaxillofacial (CMF) deformities. This process often involves bone segmentation and landmark digitization. Since anatomical landmarks generally lie on the boundaries of segmented bone regions, the tasks of bone segmentation and landmark digitization could be highly correlated. However, most existing methods simply treat them as two standalone tasks, without considering their inherent association. In addition, these methods usually ignore the spatial context information (i.e., displacements from voxels to landmarks) in CBCT images. To this end, we propose a context-guided fully convolutional network (FCN) for joint bone segmentation and landmark digitization. Specifically, we first train an FCN to learn the displacement maps to capture the spatial context information in CBCT images. Using the learned displacement maps as guidance information, we further develop a multi-task FCN to jointly perform bone segmentation and landmark digitization. Our method has been evaluated on 107 subjects from two centers, and the experimental results show that our method is superior to the state-of-the-art methods in both bone segmentation and landmark digitization.",
author = "Jun Zhang and Mingxia Liu and Li Wang and Si Chen and Peng Yuan and Jianfu Li and Shen, {Steve Guo Fang} and Zhen Tang and Chen, {Ken Chung} and Xia, {James J.} and Dinggang Shen",
year = "2017",
doi = "10.1007/978-3-319-66185-8_81",
language = "English",
isbn = "9783319661841",
volume = "10434 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "720--728",
booktitle = "Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings",

}

TY - GEN

T1 - Joint craniomaxillofacial bone segmentation and landmark digitization by context-guided fully convolutional networks

AU - Zhang, Jun

AU - Liu, Mingxia

AU - Wang, Li

AU - Chen, Si

AU - Yuan, Peng

AU - Li, Jianfu

AU - Shen, Steve Guo Fang

AU - Tang, Zhen

AU - Chen, Ken Chung

AU - Xia, James J.

AU - Shen, Dinggang

PY - 2017

Y1 - 2017

N2 - Generating accurate 3D models from cone-beam computed tomography (CBCT) images is an important step in developing treatment plans for patients with craniomaxillofacial (CMF) deformities. This process often involves bone segmentation and landmark digitization. Since anatomical landmarks generally lie on the boundaries of segmented bone regions, the tasks of bone segmentation and landmark digitization could be highly correlated. However, most existing methods simply treat them as two standalone tasks, without considering their inherent association. In addition, these methods usually ignore the spatial context information (i.e., displacements from voxels to landmarks) in CBCT images. To this end, we propose a context-guided fully convolutional network (FCN) for joint bone segmentation and landmark digitization. Specifically, we first train an FCN to learn the displacement maps to capture the spatial context information in CBCT images. Using the learned displacement maps as guidance information, we further develop a multi-task FCN to jointly perform bone segmentation and landmark digitization. Our method has been evaluated on 107 subjects from two centers, and the experimental results show that our method is superior to the state-of-the-art methods in both bone segmentation and landmark digitization.

AB - Generating accurate 3D models from cone-beam computed tomography (CBCT) images is an important step in developing treatment plans for patients with craniomaxillofacial (CMF) deformities. This process often involves bone segmentation and landmark digitization. Since anatomical landmarks generally lie on the boundaries of segmented bone regions, the tasks of bone segmentation and landmark digitization could be highly correlated. However, most existing methods simply treat them as two standalone tasks, without considering their inherent association. In addition, these methods usually ignore the spatial context information (i.e., displacements from voxels to landmarks) in CBCT images. To this end, we propose a context-guided fully convolutional network (FCN) for joint bone segmentation and landmark digitization. Specifically, we first train an FCN to learn the displacement maps to capture the spatial context information in CBCT images. Using the learned displacement maps as guidance information, we further develop a multi-task FCN to jointly perform bone segmentation and landmark digitization. Our method has been evaluated on 107 subjects from two centers, and the experimental results show that our method is superior to the state-of-the-art methods in both bone segmentation and landmark digitization.

UR - http://www.scopus.com/inward/record.url?scp=85029508832&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029508832&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-66185-8_81

DO - 10.1007/978-3-319-66185-8_81

M3 - Conference contribution

SN - 9783319661841

VL - 10434 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 720

EP - 728

BT - Medical Image Computing and Computer Assisted Intervention − MICCAI 2017 - 20th International Conference, Proceedings

PB - Springer Verlag

ER -