Sequential clique optimization for video object segmentation

Yeong Jun Koh, Young Yoon Lee, Chang-Su Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A novel algorithm to segment out objects in a video sequence is proposed in this work. First, we extract object instances in each frame. Then, we select a visually important object instance in each frame to construct the salient object track through the sequence. This can be formulated as finding the maximal weight clique in a complete k-partite graph, which is NP hard. Therefore, we develop the sequential clique optimization (SCO) technique to efficiently determine the cliques corresponding to salient object tracks. We convert these tracks into video object segmentation results. Experimental results show that the proposed algorithm significantly outperforms the state-of-the-art video object segmentation and video salient object detection algorithms on recent benchmark datasets.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings
EditorsVittorio Ferrari, Cristian Sminchisescu, Yair Weiss, Martial Hebert
PublisherSpringer Verlag
Pages537-556
Number of pages20
ISBN (Print)9783030012632
DOIs
Publication statusPublished - 2018 Jan 1
Event15th European Conference on Computer Vision, ECCV 2018 - Munich, Germany
Duration: 2018 Sep 82018 Sep 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11218 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other15th European Conference on Computer Vision, ECCV 2018
CountryGermany
CityMunich
Period18/9/818/9/14

Fingerprint

Clique
Segmentation
Optimization
Object Detection
Object
Optimization Techniques
Convert
NP-complete problem
Benchmark
Experimental Results
Graph in graph theory

Keywords

  • Primary object segmentation
  • Salient object detection
  • Sequential clique optimization
  • Video object segmentation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Koh, Y. J., Lee, Y. Y., & Kim, C-S. (2018). Sequential clique optimization for video object segmentation. In V. Ferrari, C. Sminchisescu, Y. Weiss, & M. Hebert (Eds.), Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings (pp. 537-556). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11218 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-01264-9_32

Sequential clique optimization for video object segmentation. / Koh, Yeong Jun; Lee, Young Yoon; Kim, Chang-Su.

Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. ed. / Vittorio Ferrari; Cristian Sminchisescu; Yair Weiss; Martial Hebert. Springer Verlag, 2018. p. 537-556 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11218 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Koh, YJ, Lee, YY & Kim, C-S 2018, Sequential clique optimization for video object segmentation. in V Ferrari, C Sminchisescu, Y Weiss & M Hebert (eds), Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11218 LNCS, Springer Verlag, pp. 537-556, 15th European Conference on Computer Vision, ECCV 2018, Munich, Germany, 18/9/8. https://doi.org/10.1007/978-3-030-01264-9_32
Koh YJ, Lee YY, Kim C-S. Sequential clique optimization for video object segmentation. In Ferrari V, Sminchisescu C, Weiss Y, Hebert M, editors, Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. Springer Verlag. 2018. p. 537-556. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-01264-9_32
Koh, Yeong Jun ; Lee, Young Yoon ; Kim, Chang-Su. / Sequential clique optimization for video object segmentation. Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. editor / Vittorio Ferrari ; Cristian Sminchisescu ; Yair Weiss ; Martial Hebert. Springer Verlag, 2018. pp. 537-556 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{4c9ebb3a32b8450d8538e5e4798ff722,
title = "Sequential clique optimization for video object segmentation",
abstract = "A novel algorithm to segment out objects in a video sequence is proposed in this work. First, we extract object instances in each frame. Then, we select a visually important object instance in each frame to construct the salient object track through the sequence. This can be formulated as finding the maximal weight clique in a complete k-partite graph, which is NP hard. Therefore, we develop the sequential clique optimization (SCO) technique to efficiently determine the cliques corresponding to salient object tracks. We convert these tracks into video object segmentation results. Experimental results show that the proposed algorithm significantly outperforms the state-of-the-art video object segmentation and video salient object detection algorithms on recent benchmark datasets.",
keywords = "Primary object segmentation, Salient object detection, Sequential clique optimization, Video object segmentation",
author = "Koh, {Yeong Jun} and Lee, {Young Yoon} and Chang-Su Kim",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01264-9_32",
language = "English",
isbn = "9783030012632",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "537--556",
editor = "Vittorio Ferrari and Cristian Sminchisescu and Yair Weiss and Martial Hebert",
booktitle = "Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings",

}

TY - GEN

T1 - Sequential clique optimization for video object segmentation

AU - Koh, Yeong Jun

AU - Lee, Young Yoon

AU - Kim, Chang-Su

PY - 2018/1/1

Y1 - 2018/1/1

N2 - A novel algorithm to segment out objects in a video sequence is proposed in this work. First, we extract object instances in each frame. Then, we select a visually important object instance in each frame to construct the salient object track through the sequence. This can be formulated as finding the maximal weight clique in a complete k-partite graph, which is NP hard. Therefore, we develop the sequential clique optimization (SCO) technique to efficiently determine the cliques corresponding to salient object tracks. We convert these tracks into video object segmentation results. Experimental results show that the proposed algorithm significantly outperforms the state-of-the-art video object segmentation and video salient object detection algorithms on recent benchmark datasets.

AB - A novel algorithm to segment out objects in a video sequence is proposed in this work. First, we extract object instances in each frame. Then, we select a visually important object instance in each frame to construct the salient object track through the sequence. This can be formulated as finding the maximal weight clique in a complete k-partite graph, which is NP hard. Therefore, we develop the sequential clique optimization (SCO) technique to efficiently determine the cliques corresponding to salient object tracks. We convert these tracks into video object segmentation results. Experimental results show that the proposed algorithm significantly outperforms the state-of-the-art video object segmentation and video salient object detection algorithms on recent benchmark datasets.

KW - Primary object segmentation

KW - Salient object detection

KW - Sequential clique optimization

KW - Video object segmentation

UR - http://www.scopus.com/inward/record.url?scp=85055709556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055709556&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01264-9_32

DO - 10.1007/978-3-030-01264-9_32

M3 - Conference contribution

AN - SCOPUS:85055709556

SN - 9783030012632

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 537

EP - 556

BT - Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings

A2 - Ferrari, Vittorio

A2 - Sminchisescu, Cristian

A2 - Weiss, Yair

A2 - Hebert, Martial

PB - Springer Verlag

ER -