A deep interactive segmentation method with user interaction-based attention module and polar transformation

Jee Young Sun, Sang Won Lee, Ye Won Kim, Bo Sang Kim, Sung Jea Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Interactive segmentation that extracts a specific foreground selected by the user input is widely employed in many user-interactive applications such as image editing and ground-truth labeling. In general, most interactive segmentation methods iteratively refine the previously obtained result using additional user interactions because they often produce unsatisfactory results with a single user input. A recently developed convolutional neural network (CNN)-based interactive segmentation method called deep interactive object selection has achieved high segmentation accuracy with fewer user interactions than earlier non-CNN-based approaches. However, the computational efficiency of deep interactive object selection deteriorates due to the repetitive feature extraction stage for each user interaction. Furthermore, the deep interactive object selection requires graph cut as a post-processing step to refine the boundary segments. To solve this problem, this paper presents a deep CNN-based interactive segmentation method employing an effective and simple user interaction-based attention module that does not require the repetitive feature extraction. In addition, we adopt Cartesian to polar coordinate transformation to further improve the segmentation performance. Experimental results demonstrate that the proposed interactive segmentation method is superior to the conventional ones in terms of segmentation accuracy and computational efficiency.

Original languageEnglish
Title of host publication12th International Conference on Machine Vision, ICMV 2019
EditorsWolfgang Osten, Dmitry Nikolaev, Jianhong Zhou
PublisherSPIE
ISBN (Electronic)9781510636439
DOIs
Publication statusPublished - 2020 Jan 1
Event12th International Conference on Machine Vision, ICMV 2019 - Amsterdam, Netherlands
Duration: 2019 Nov 162019 Nov 18

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11433
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference12th International Conference on Machine Vision, ICMV 2019
CountryNetherlands
CityAmsterdam
Period19/11/1619/11/18

Keywords

  • Cartesian to polar coordinate transformation
  • Convolutional neural network
  • Interactive segmentation
  • User interaction
  • User interaction-based attention module

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'A deep interactive segmentation method with user interaction-based attention module and polar transformation'. Together they form a unique fingerprint.

  • Cite this

    Sun, J. Y., Lee, S. W., Kim, Y. W., Kim, B. S., & Ko, S. J. (2020). A deep interactive segmentation method with user interaction-based attention module and polar transformation. In W. Osten, D. Nikolaev, & J. Zhou (Eds.), 12th International Conference on Machine Vision, ICMV 2019 [114331B] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11433). SPIE. https://doi.org/10.1117/12.2556671