Efficient depth video coding based on view synthesis distortion estimation

Tae Young Chung, Won Dong Jang, Chang-Su Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

An efficient coding algorithm for depth map images and videos, based on view synthesis distortion estimation, is proposed in this work. We first analyze how a depth error is related to a disparity error and how the disparity vector error affects the energy spectral density of a synthesized color video in the frequency domain. Based on the analysis, we propose an estimation technique to predict the view synthesis distortion without requiring the actual synthesis of intermediate view frames. To encode the depth information efficiently, we employ a Lagrangian cost function to minimize the view synthesis distortion subject to the constraint on a transmission bit rate. In addition, we develop a quantization scheme for residual depth data, which adaptively assigns bits according to block complexities. Simulation results demonstrate that the proposed depth video coding algorithm provides significantly better R-D performance than conventional algorithms.

Original languageEnglish
Title of host publication2012 IEEE Visual Communications and Image Processing, VCIP 2012
DOIs
Publication statusPublished - 2012 Dec 1
Event2012 IEEE Visual Communications and Image Processing, VCIP 2012 - San Diego, CA, United States
Duration: 2012 Nov 272012 Nov 30

Other

Other2012 IEEE Visual Communications and Image Processing, VCIP 2012
CountryUnited States
CitySan Diego, CA
Period12/11/2712/11/30

Fingerprint

Image coding
Spectral density
Cost functions
Color

Keywords

  • depth video coding
  • energy spectral density
  • Multi-view plus depth
  • view synthesis distortion

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Chung, T. Y., Jang, W. D., & Kim, C-S. (2012). Efficient depth video coding based on view synthesis distortion estimation. In 2012 IEEE Visual Communications and Image Processing, VCIP 2012 [6410844] https://doi.org/10.1109/VCIP.2012.6410844

Efficient depth video coding based on view synthesis distortion estimation. / Chung, Tae Young; Jang, Won Dong; Kim, Chang-Su.

2012 IEEE Visual Communications and Image Processing, VCIP 2012. 2012. 6410844.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chung, TY, Jang, WD & Kim, C-S 2012, Efficient depth video coding based on view synthesis distortion estimation. in 2012 IEEE Visual Communications and Image Processing, VCIP 2012., 6410844, 2012 IEEE Visual Communications and Image Processing, VCIP 2012, San Diego, CA, United States, 12/11/27. https://doi.org/10.1109/VCIP.2012.6410844
Chung TY, Jang WD, Kim C-S. Efficient depth video coding based on view synthesis distortion estimation. In 2012 IEEE Visual Communications and Image Processing, VCIP 2012. 2012. 6410844 https://doi.org/10.1109/VCIP.2012.6410844
Chung, Tae Young ; Jang, Won Dong ; Kim, Chang-Su. / Efficient depth video coding based on view synthesis distortion estimation. 2012 IEEE Visual Communications and Image Processing, VCIP 2012. 2012.
@inproceedings{cba5226efa7d4530b8f9c2eb3ec2b9ed,
title = "Efficient depth video coding based on view synthesis distortion estimation",
abstract = "An efficient coding algorithm for depth map images and videos, based on view synthesis distortion estimation, is proposed in this work. We first analyze how a depth error is related to a disparity error and how the disparity vector error affects the energy spectral density of a synthesized color video in the frequency domain. Based on the analysis, we propose an estimation technique to predict the view synthesis distortion without requiring the actual synthesis of intermediate view frames. To encode the depth information efficiently, we employ a Lagrangian cost function to minimize the view synthesis distortion subject to the constraint on a transmission bit rate. In addition, we develop a quantization scheme for residual depth data, which adaptively assigns bits according to block complexities. Simulation results demonstrate that the proposed depth video coding algorithm provides significantly better R-D performance than conventional algorithms.",
keywords = "depth video coding, energy spectral density, Multi-view plus depth, view synthesis distortion",
author = "Chung, {Tae Young} and Jang, {Won Dong} and Chang-Su Kim",
year = "2012",
month = "12",
day = "1",
doi = "10.1109/VCIP.2012.6410844",
language = "English",
isbn = "9781467344050",
booktitle = "2012 IEEE Visual Communications and Image Processing, VCIP 2012",

}

TY - GEN

T1 - Efficient depth video coding based on view synthesis distortion estimation

AU - Chung, Tae Young

AU - Jang, Won Dong

AU - Kim, Chang-Su

PY - 2012/12/1

Y1 - 2012/12/1

N2 - An efficient coding algorithm for depth map images and videos, based on view synthesis distortion estimation, is proposed in this work. We first analyze how a depth error is related to a disparity error and how the disparity vector error affects the energy spectral density of a synthesized color video in the frequency domain. Based on the analysis, we propose an estimation technique to predict the view synthesis distortion without requiring the actual synthesis of intermediate view frames. To encode the depth information efficiently, we employ a Lagrangian cost function to minimize the view synthesis distortion subject to the constraint on a transmission bit rate. In addition, we develop a quantization scheme for residual depth data, which adaptively assigns bits according to block complexities. Simulation results demonstrate that the proposed depth video coding algorithm provides significantly better R-D performance than conventional algorithms.

AB - An efficient coding algorithm for depth map images and videos, based on view synthesis distortion estimation, is proposed in this work. We first analyze how a depth error is related to a disparity error and how the disparity vector error affects the energy spectral density of a synthesized color video in the frequency domain. Based on the analysis, we propose an estimation technique to predict the view synthesis distortion without requiring the actual synthesis of intermediate view frames. To encode the depth information efficiently, we employ a Lagrangian cost function to minimize the view synthesis distortion subject to the constraint on a transmission bit rate. In addition, we develop a quantization scheme for residual depth data, which adaptively assigns bits according to block complexities. Simulation results demonstrate that the proposed depth video coding algorithm provides significantly better R-D performance than conventional algorithms.

KW - depth video coding

KW - energy spectral density

KW - Multi-view plus depth

KW - view synthesis distortion

UR - http://www.scopus.com/inward/record.url?scp=84874075304&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84874075304&partnerID=8YFLogxK

U2 - 10.1109/VCIP.2012.6410844

DO - 10.1109/VCIP.2012.6410844

M3 - Conference contribution

AN - SCOPUS:84874075304

SN - 9781467344050

BT - 2012 IEEE Visual Communications and Image Processing, VCIP 2012

ER -