mr$$^2$$ NST: Multi-resolution and Multi-reference Neural Style Transfer for Mammography

Sheng Wang, Jiayu Huo, Xi Ouyang, Jifei Che, Zhong Xue, Dinggang Shen, Qian Wang, Jie Zhi Cheng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Computer-aided diagnosis with deep learning techniques has been shown to be helpful for the diagnosis of the mammography in many clinical studies. However, the image styles of different vendors are very distinctive, and there may exist domain gap among different vendors that could potentially compromise the universal applicability of one deep learning model. In this study, we explicitly address style variety issue with the proposed multi-resolution and multi-reference neural style transfer (mr2NST) network. The mr2NST can normalize the styles from different vendors to the same style baseline with very high resolution. We illustrate that the image quality of the transferred images is comparable to the quality of original images of the target domain (vendor) in terms of NIMA scores. Meanwhile, the mr2NST results are also shown to be helpful for the lesion detection in mammograms.

Original languageEnglish
Title of host publicationPredictive Intelligence in Medicine - 3rd International Workshop, PRIME 2020, Held in Conjunction with MICCAI 2020, Proceedings
EditorsIslem Rekik, Ehsan Adeli, Sang Hyun Park, Maria del C. Valdés Hernández
PublisherSpringer Science and Business Media Deutschland GmbH
Pages169-177
Number of pages9
ISBN (Print)9783030593537
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event3rd International Workshop on Predictive Intelligence in Medicine, PRIME 2020, held in conjunction with the Medical Image Computing and Computer Assisted Intervention, MICCAI 2020 - Lima, Peru
Duration: 2020 Oct 82020 Oct 8

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12329 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd International Workshop on Predictive Intelligence in Medicine, PRIME 2020, held in conjunction with the Medical Image Computing and Computer Assisted Intervention, MICCAI 2020
Country/TerritoryPeru
CityLima
Period20/10/820/10/8

Keywords

  • Mammography
  • Neural style transfer
  • Style normalization

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'mr$$^2$$ NST: Multi-resolution and Multi-reference Neural Style Transfer for Mammography'. Together they form a unique fingerprint.

Cite this