Depth sensation enhancement using the just noticeable depth difference

Seung Won Jung, Sung-Jea Ko

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

In this paper, we present a novel depth sensation enhancement algorithm considering the behavior of human visual system toward stereoscopic image displays. On the basis of the recent studies on the just noticeable depth difference (JNDD), which represents a threshold at which a human can perceive the depth difference between objects, we modify the depth image such that neighboring objects in the depth image can have a depth value difference of at least the JNDD. This modification is modeled via an energy minimization framework using three energy terms defined as depth data preservation, depth order preservation, and depth difference expansion. The depth data term enforces minimal changes in the depth image with an additional weighting function that controls the direction of depth changes. The depth order term restricts the inversion of the local and global depth orders among objects, and the JNDD term leads to an increase in the depth differences between segments. Throughout subjective quality evaluation on a stereoscopic image display, it is demonstrated that the human depth sensation is effectively improved by the proposed algorithm.

Original languageEnglish
Article number6172572
Pages (from-to)3624-3637
Number of pages14
JournalIEEE Transactions on Image Processing
Volume21
Issue number8
DOIs
Publication statusPublished - 2012 Jul 27

Fingerprint

Differential Threshold
Display devices

Keywords

  • Depth enhancement
  • Depth image-based rendering
  • Depth sensation
  • Human visual system (HVS)
  • Just noticeable depth difference (JNDD)

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software
  • Medicine(all)

Cite this

Depth sensation enhancement using the just noticeable depth difference. / Jung, Seung Won; Ko, Sung-Jea.

In: IEEE Transactions on Image Processing, Vol. 21, No. 8, 6172572, 27.07.2012, p. 3624-3637.

Research output: Contribution to journalArticle

@article{5d81a648285f405d82550f4f4bad65ed,
title = "Depth sensation enhancement using the just noticeable depth difference",
abstract = "In this paper, we present a novel depth sensation enhancement algorithm considering the behavior of human visual system toward stereoscopic image displays. On the basis of the recent studies on the just noticeable depth difference (JNDD), which represents a threshold at which a human can perceive the depth difference between objects, we modify the depth image such that neighboring objects in the depth image can have a depth value difference of at least the JNDD. This modification is modeled via an energy minimization framework using three energy terms defined as depth data preservation, depth order preservation, and depth difference expansion. The depth data term enforces minimal changes in the depth image with an additional weighting function that controls the direction of depth changes. The depth order term restricts the inversion of the local and global depth orders among objects, and the JNDD term leads to an increase in the depth differences between segments. Throughout subjective quality evaluation on a stereoscopic image display, it is demonstrated that the human depth sensation is effectively improved by the proposed algorithm.",
keywords = "Depth enhancement, Depth image-based rendering, Depth sensation, Human visual system (HVS), Just noticeable depth difference (JNDD)",
author = "Jung, {Seung Won} and Sung-Jea Ko",
year = "2012",
month = "7",
day = "27",
doi = "10.1109/TIP.2012.2191569",
language = "English",
volume = "21",
pages = "3624--3637",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "8",

}

TY - JOUR

T1 - Depth sensation enhancement using the just noticeable depth difference

AU - Jung, Seung Won

AU - Ko, Sung-Jea

PY - 2012/7/27

Y1 - 2012/7/27

N2 - In this paper, we present a novel depth sensation enhancement algorithm considering the behavior of human visual system toward stereoscopic image displays. On the basis of the recent studies on the just noticeable depth difference (JNDD), which represents a threshold at which a human can perceive the depth difference between objects, we modify the depth image such that neighboring objects in the depth image can have a depth value difference of at least the JNDD. This modification is modeled via an energy minimization framework using three energy terms defined as depth data preservation, depth order preservation, and depth difference expansion. The depth data term enforces minimal changes in the depth image with an additional weighting function that controls the direction of depth changes. The depth order term restricts the inversion of the local and global depth orders among objects, and the JNDD term leads to an increase in the depth differences between segments. Throughout subjective quality evaluation on a stereoscopic image display, it is demonstrated that the human depth sensation is effectively improved by the proposed algorithm.

AB - In this paper, we present a novel depth sensation enhancement algorithm considering the behavior of human visual system toward stereoscopic image displays. On the basis of the recent studies on the just noticeable depth difference (JNDD), which represents a threshold at which a human can perceive the depth difference between objects, we modify the depth image such that neighboring objects in the depth image can have a depth value difference of at least the JNDD. This modification is modeled via an energy minimization framework using three energy terms defined as depth data preservation, depth order preservation, and depth difference expansion. The depth data term enforces minimal changes in the depth image with an additional weighting function that controls the direction of depth changes. The depth order term restricts the inversion of the local and global depth orders among objects, and the JNDD term leads to an increase in the depth differences between segments. Throughout subjective quality evaluation on a stereoscopic image display, it is demonstrated that the human depth sensation is effectively improved by the proposed algorithm.

KW - Depth enhancement

KW - Depth image-based rendering

KW - Depth sensation

KW - Human visual system (HVS)

KW - Just noticeable depth difference (JNDD)

UR - http://www.scopus.com/inward/record.url?scp=84864147836&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84864147836&partnerID=8YFLogxK

U2 - 10.1109/TIP.2012.2191569

DO - 10.1109/TIP.2012.2191569

M3 - Article

VL - 21

SP - 3624

EP - 3637

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 8

M1 - 6172572

ER -