Rate-distortion optimized layered coding of high dynamic range videos

Chul Lee, Chang-Su Kim

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

An efficient algorithm to compress high dynamic range (HDR) videos into layered bitstreams is proposed in this work. First, we separate an HDR video sequence into a tone-mapped low dynamic range (LDR) sequence and a ratio sequence, which represents ratios between HDR and LDR pixel values. Then, we encode the LDR and ratio sequences to maximize the rate-distortion (R-D) performance by extending the standard H.264/AVC codec. Specifically, we estimate the distortion of the HDR sequence from those of the LDR sequence and the ratio sequence, and then allocate a limited bit budget to the LDR sequence and the ratio sequence efficiently to maximize the qualities of both LDR and HDR sequences. Conventional LDR devices use only the LDR stream, whereas HDR devices reconstruct the HDR video from the LDR and ratio streams. Simulation results show that the proposed algorithm provides significantly better R-D performance than conventional HDR video coding techniques.

Original languageEnglish
Pages (from-to)908-923
Number of pages16
JournalJournal of Visual Communication and Image Representation
Volume23
Issue number6
DOIs
Publication statusPublished - 2012 Aug 1

Fingerprint

Image coding
Pixels

Keywords

  • Backward compatibility
  • H.264/AVC
  • High dynamic range video
  • Human visual system
  • Layered coding
  • Rate-distortion optimization
  • Tone mapping
  • Video coding

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Rate-distortion optimized layered coding of high dynamic range videos. / Lee, Chul; Kim, Chang-Su.

In: Journal of Visual Communication and Image Representation, Vol. 23, No. 6, 01.08.2012, p. 908-923.

Research output: Contribution to journalArticle

@article{79c9e8a0419141eb8920498585ae8774,
title = "Rate-distortion optimized layered coding of high dynamic range videos",
abstract = "An efficient algorithm to compress high dynamic range (HDR) videos into layered bitstreams is proposed in this work. First, we separate an HDR video sequence into a tone-mapped low dynamic range (LDR) sequence and a ratio sequence, which represents ratios between HDR and LDR pixel values. Then, we encode the LDR and ratio sequences to maximize the rate-distortion (R-D) performance by extending the standard H.264/AVC codec. Specifically, we estimate the distortion of the HDR sequence from those of the LDR sequence and the ratio sequence, and then allocate a limited bit budget to the LDR sequence and the ratio sequence efficiently to maximize the qualities of both LDR and HDR sequences. Conventional LDR devices use only the LDR stream, whereas HDR devices reconstruct the HDR video from the LDR and ratio streams. Simulation results show that the proposed algorithm provides significantly better R-D performance than conventional HDR video coding techniques.",
keywords = "Backward compatibility, H.264/AVC, High dynamic range video, Human visual system, Layered coding, Rate-distortion optimization, Tone mapping, Video coding",
author = "Chul Lee and Chang-Su Kim",
year = "2012",
month = "8",
day = "1",
doi = "10.1016/j.jvcir.2012.05.009",
language = "English",
volume = "23",
pages = "908--923",
journal = "Journal of Visual Communication and Image Representation",
issn = "1047-3203",
publisher = "Academic Press Inc.",
number = "6",

}

TY - JOUR

T1 - Rate-distortion optimized layered coding of high dynamic range videos

AU - Lee, Chul

AU - Kim, Chang-Su

PY - 2012/8/1

Y1 - 2012/8/1

N2 - An efficient algorithm to compress high dynamic range (HDR) videos into layered bitstreams is proposed in this work. First, we separate an HDR video sequence into a tone-mapped low dynamic range (LDR) sequence and a ratio sequence, which represents ratios between HDR and LDR pixel values. Then, we encode the LDR and ratio sequences to maximize the rate-distortion (R-D) performance by extending the standard H.264/AVC codec. Specifically, we estimate the distortion of the HDR sequence from those of the LDR sequence and the ratio sequence, and then allocate a limited bit budget to the LDR sequence and the ratio sequence efficiently to maximize the qualities of both LDR and HDR sequences. Conventional LDR devices use only the LDR stream, whereas HDR devices reconstruct the HDR video from the LDR and ratio streams. Simulation results show that the proposed algorithm provides significantly better R-D performance than conventional HDR video coding techniques.

AB - An efficient algorithm to compress high dynamic range (HDR) videos into layered bitstreams is proposed in this work. First, we separate an HDR video sequence into a tone-mapped low dynamic range (LDR) sequence and a ratio sequence, which represents ratios between HDR and LDR pixel values. Then, we encode the LDR and ratio sequences to maximize the rate-distortion (R-D) performance by extending the standard H.264/AVC codec. Specifically, we estimate the distortion of the HDR sequence from those of the LDR sequence and the ratio sequence, and then allocate a limited bit budget to the LDR sequence and the ratio sequence efficiently to maximize the qualities of both LDR and HDR sequences. Conventional LDR devices use only the LDR stream, whereas HDR devices reconstruct the HDR video from the LDR and ratio streams. Simulation results show that the proposed algorithm provides significantly better R-D performance than conventional HDR video coding techniques.

KW - Backward compatibility

KW - H.264/AVC

KW - High dynamic range video

KW - Human visual system

KW - Layered coding

KW - Rate-distortion optimization

KW - Tone mapping

KW - Video coding

UR - http://www.scopus.com/inward/record.url?scp=84862734877&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862734877&partnerID=8YFLogxK

U2 - 10.1016/j.jvcir.2012.05.009

DO - 10.1016/j.jvcir.2012.05.009

M3 - Article

VL - 23

SP - 908

EP - 923

JO - Journal of Visual Communication and Image Representation

JF - Journal of Visual Communication and Image Representation

SN - 1047-3203

IS - 6

ER -