Frame loss concealment for stereoscopic video plus depth sequences

Tae Young Chung, Sanghoon Sull, Chang-Su Kim

Research output: Contribution to journalArticle

29 Citations (Scopus)

Abstract

In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ

Original languageEnglish
Article number6018892
Pages (from-to)1336-1344
Number of pages9
JournalIEEE Transactions on Consumer Electronics
Volume57
Issue number3
DOIs
Publication statusPublished - 2011 Aug 1

Fingerprint

Color
Pixels

Keywords

  • 3D image warping
  • 3D video warping
  • frameconcealment
  • multi-view video
  • video plus depth sequence

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology

Cite this

Frame loss concealment for stereoscopic video plus depth sequences. / Chung, Tae Young; Sull, Sanghoon; Kim, Chang-Su.

In: IEEE Transactions on Consumer Electronics, Vol. 57, No. 3, 6018892, 01.08.2011, p. 1336-1344.

Research output: Contribution to journalArticle

@article{12e875b727ae4c8f8798b132ade8cc33,
title = "Frame loss concealment for stereoscopic video plus depth sequences",
abstract = "In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ",
keywords = "3D image warping, 3D video warping, frameconcealment, multi-view video, video plus depth sequence",
author = "Chung, {Tae Young} and Sanghoon Sull and Chang-Su Kim",
year = "2011",
month = "8",
day = "1",
doi = "10.1109/TCE.2011.6018892",
language = "English",
volume = "57",
pages = "1336--1344",
journal = "IEEE Transactions on Consumer Electronics",
issn = "0098-3063",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Frame loss concealment for stereoscopic video plus depth sequences

AU - Chung, Tae Young

AU - Sull, Sanghoon

AU - Kim, Chang-Su

PY - 2011/8/1

Y1 - 2011/8/1

N2 - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ

AB - In this work, an efficient frame loss concealment algorithm for stereoscopic video plus depth sequences is proposed. To conceal an erroneous left color frame, we extrapolate motion vectors for the temporal error concealment. To conceal a left depth frame, we exploit the motion vectors of the corresponding left color frame. To conceal a right color frame, we employ a 3D image warping technique to determine matching pixels between inter-views, and perform the reconstruction based on the similarities of the motion vectors and the intensity differences of matching pixels. Finally, to conceal a right depth frame, we use the motion vectors of the right color frame and the left color frame. Simulation results show that the proposed algorithm is more effective than conventional algorithms in recovering erroneous color and depth frames. Moreover, it is also demonstrated that the proposed algorithm can be used for efficient virtual view synthesis in error prone environments.ǎ

KW - 3D image warping

KW - 3D video warping

KW - frameconcealment

KW - multi-view video

KW - video plus depth sequence

UR - http://www.scopus.com/inward/record.url?scp=80052934378&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052934378&partnerID=8YFLogxK

U2 - 10.1109/TCE.2011.6018892

DO - 10.1109/TCE.2011.6018892

M3 - Article

VL - 57

SP - 1336

EP - 1344

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

SN - 0098-3063

IS - 3

M1 - 6018892

ER -