Object boundary detection and classification with image-level labels

Jing Yu Koh, Wojciech Samek, Klaus Muller, Alexander Binder

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Semantic boundary and edge detection aims at simultaneously detecting object edge pixels in images and assigning class labels to them. Systematic training of predictors for this task requires the labeling of edges in images which is a particularly tedious task. We propose a novel strategy for solving this task, when pixel-level annotations are not available, performing it in an almost zero-shot manner by relying on conventional whole image neural net classifiers that were trained using large bounding boxes. Our method performs the following two steps at test time. Firstly it predicts the class labels by applying the trained whole image network to the test images. Secondly, it computes pixel-wise scores from the obtained predictions by applying backprop gradients as well as recent visualization algorithms such as deconvolution and layer-wise relevance propagation. We show that high pixel-wise scores are indicative for the location of semantic boundaries, which suggests that the semantic boundary problem can be approached without using edge labels during the training phase.

Original languageEnglish
Title of host publicationPattern Recognition - 39th German Conference, GCPR 2017, Proceedings
PublisherSpringer Verlag
Pages153-164
Number of pages12
Volume10496 LNCS
ISBN (Print)9783319667089
DOIs
Publication statusPublished - 2017
Event39th German Conference on Pattern Recognition, GCPR 2017 - Basel, Switzerland
Duration: 2017 Sep 122017 Sep 15

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10496 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other39th German Conference on Pattern Recognition, GCPR 2017
CountrySwitzerland
CityBasel
Period17/9/1217/9/15

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Object boundary detection and classification with image-level labels'. Together they form a unique fingerprint.

  • Cite this

    Koh, J. Y., Samek, W., Muller, K., & Binder, A. (2017). Object boundary detection and classification with image-level labels. In Pattern Recognition - 39th German Conference, GCPR 2017, Proceedings (Vol. 10496 LNCS, pp. 153-164). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10496 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-66709-6_13