Learning-based multimodal image registration for prostate cancer radiation therapy

Xiaohuan Cao, Yaozong Gao, Jianhua Yang, Guorong Wu, Dinggang Shen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

Computed tomography (CT) is widely used for dose planning in the radiotherapy of prostate cancer. However,CT has low tissue contrast,thus making manual contouring difficult. In contrast,magnetic resonance (MR) image provides high tissue contrast and is thus ideal for manual contouring. If MR image can be registered to CT image of the same patient,the contouring accuracy of CT could be substantially improved,which could eventually lead to high treatment efficacy. In this paper,we propose a learning-based approach for multimodal image registration. First,to fill the appearance gap between modalities,a structured random forest with auto-context model is learnt to synthesize MRI from CT and vice versa. Then,MRI-to-CT registration is steered in a dual manner of registering images with same appearances,i.e.,(1) registering the synthesized CT with CT,and (2) also registering MRI with the synthesized MRI. Next,a dual-core deformation fusion framework is developed to iteratively and effectively combine these two registration results. Experiments on pelvic CT and MR images have shown the improved registration performance by our proposed method,compared with the existing nonlearning based registration methods.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings
PublisherSpringer Verlag
Pages1-9
Number of pages9
Volume9902 LNCS
ISBN (Print)9783319467252
DOIs
Publication statusPublished - 2016
Externally publishedYes

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9902 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Fingerprint

Radiation Therapy
Prostate Cancer
Image registration
Radiotherapy
Computed Tomography
Image Registration
Tomography
Magnetic resonance imaging
Registration
Magnetic Resonance Image
Magnetic resonance
Tissue
Learning
Random Forest
Modality
Dosimetry
Efficacy
Dose
Fusion
Fusion reactions

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Cao, X., Gao, Y., Yang, J., Wu, G., & Shen, D. (2016). Learning-based multimodal image registration for prostate cancer radiation therapy. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings (Vol. 9902 LNCS, pp. 1-9). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9902 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-46726-9_1

Learning-based multimodal image registration for prostate cancer radiation therapy. / Cao, Xiaohuan; Gao, Yaozong; Yang, Jianhua; Wu, Guorong; Shen, Dinggang.

Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9902 LNCS Springer Verlag, 2016. p. 1-9 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9902 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cao, X, Gao, Y, Yang, J, Wu, G & Shen, D 2016, Learning-based multimodal image registration for prostate cancer radiation therapy. in Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. vol. 9902 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9902 LNCS, Springer Verlag, pp. 1-9. https://doi.org/10.1007/978-3-319-46726-9_1
Cao X, Gao Y, Yang J, Wu G, Shen D. Learning-based multimodal image registration for prostate cancer radiation therapy. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9902 LNCS. Springer Verlag. 2016. p. 1-9. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-46726-9_1
Cao, Xiaohuan ; Gao, Yaozong ; Yang, Jianhua ; Wu, Guorong ; Shen, Dinggang. / Learning-based multimodal image registration for prostate cancer radiation therapy. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings. Vol. 9902 LNCS Springer Verlag, 2016. pp. 1-9 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{a60de43aa1aa41a6a3605e778b1dbe51,
title = "Learning-based multimodal image registration for prostate cancer radiation therapy",
abstract = "Computed tomography (CT) is widely used for dose planning in the radiotherapy of prostate cancer. However,CT has low tissue contrast,thus making manual contouring difficult. In contrast,magnetic resonance (MR) image provides high tissue contrast and is thus ideal for manual contouring. If MR image can be registered to CT image of the same patient,the contouring accuracy of CT could be substantially improved,which could eventually lead to high treatment efficacy. In this paper,we propose a learning-based approach for multimodal image registration. First,to fill the appearance gap between modalities,a structured random forest with auto-context model is learnt to synthesize MRI from CT and vice versa. Then,MRI-to-CT registration is steered in a dual manner of registering images with same appearances,i.e.,(1) registering the synthesized CT with CT,and (2) also registering MRI with the synthesized MRI. Next,a dual-core deformation fusion framework is developed to iteratively and effectively combine these two registration results. Experiments on pelvic CT and MR images have shown the improved registration performance by our proposed method,compared with the existing nonlearning based registration methods.",
author = "Xiaohuan Cao and Yaozong Gao and Jianhua Yang and Guorong Wu and Dinggang Shen",
year = "2016",
doi = "10.1007/978-3-319-46726-9_1",
language = "English",
isbn = "9783319467252",
volume = "9902 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "1--9",
booktitle = "Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings",

}

TY - GEN

T1 - Learning-based multimodal image registration for prostate cancer radiation therapy

AU - Cao, Xiaohuan

AU - Gao, Yaozong

AU - Yang, Jianhua

AU - Wu, Guorong

AU - Shen, Dinggang

PY - 2016

Y1 - 2016

N2 - Computed tomography (CT) is widely used for dose planning in the radiotherapy of prostate cancer. However,CT has low tissue contrast,thus making manual contouring difficult. In contrast,magnetic resonance (MR) image provides high tissue contrast and is thus ideal for manual contouring. If MR image can be registered to CT image of the same patient,the contouring accuracy of CT could be substantially improved,which could eventually lead to high treatment efficacy. In this paper,we propose a learning-based approach for multimodal image registration. First,to fill the appearance gap between modalities,a structured random forest with auto-context model is learnt to synthesize MRI from CT and vice versa. Then,MRI-to-CT registration is steered in a dual manner of registering images with same appearances,i.e.,(1) registering the synthesized CT with CT,and (2) also registering MRI with the synthesized MRI. Next,a dual-core deformation fusion framework is developed to iteratively and effectively combine these two registration results. Experiments on pelvic CT and MR images have shown the improved registration performance by our proposed method,compared with the existing nonlearning based registration methods.

AB - Computed tomography (CT) is widely used for dose planning in the radiotherapy of prostate cancer. However,CT has low tissue contrast,thus making manual contouring difficult. In contrast,magnetic resonance (MR) image provides high tissue contrast and is thus ideal for manual contouring. If MR image can be registered to CT image of the same patient,the contouring accuracy of CT could be substantially improved,which could eventually lead to high treatment efficacy. In this paper,we propose a learning-based approach for multimodal image registration. First,to fill the appearance gap between modalities,a structured random forest with auto-context model is learnt to synthesize MRI from CT and vice versa. Then,MRI-to-CT registration is steered in a dual manner of registering images with same appearances,i.e.,(1) registering the synthesized CT with CT,and (2) also registering MRI with the synthesized MRI. Next,a dual-core deformation fusion framework is developed to iteratively and effectively combine these two registration results. Experiments on pelvic CT and MR images have shown the improved registration performance by our proposed method,compared with the existing nonlearning based registration methods.

UR - http://www.scopus.com/inward/record.url?scp=84996560143&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84996560143&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-46726-9_1

DO - 10.1007/978-3-319-46726-9_1

M3 - Conference contribution

C2 - 28975161

AN - SCOPUS:84996560143

SN - 9783319467252

VL - 9902 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 1

EP - 9

BT - Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016 - 19th International Conference, Proceedings

PB - Springer Verlag

ER -