Consistent stereo matching under varying radiometric conditions

Il Lyong Jung, Tae Young Chung, Jae Young Sim, Chang-Su Kim

Research output: Contribution to journalArticle

23 Citations (Scopus)

Abstract

A consistent stereo matching (CSM) algorithm under varying radiometric conditions, such as lighting and exposure variations, for intermediate view synthesis is proposed in this work. First, we transform the colors of stereo images adaptively so that they are similar at corresponding pixels. Since the correspondences are generally unknown before stereo matching, we estimate pseudo-disparity vectors by sorting pixels based on the cumulative color histograms and use those pseudo vectors in the color transform. Then, to improve the accuracy of stereo matching, we jointly estimate the disparity maps for virtual intermediate views as well as those for real views, based on the consistency criterion that an object point should have the same disparity through all the views. Specifically, we compute matching costs using the reliability term and aggregate the costs to obtain initial disparity maps. We then refine the initial disparity maps by minimizing an energy function, which includes the consistency term. Experimental results show that the proposed CSM algorithm significantly reduces the error rate of disparity estimation under different radiometric conditions and synthesizes high quality intermediate views.

Original languageEnglish
Article number6331534
Pages (from-to)56-69
Number of pages14
JournalIEEE Transactions on Multimedia
Volume15
Issue number1
DOIs
Publication statusPublished - 2013 Jan 1

Fingerprint

Color
Pixels
Sorting
Costs
Lighting

Keywords

  • Color similarity
  • color transform
  • consistency criterion
  • forward mapping
  • intermediate view synthesis
  • inverse mapping
  • stereo matching

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Signal Processing
  • Media Technology
  • Computer Science Applications

Cite this

Consistent stereo matching under varying radiometric conditions. / Jung, Il Lyong; Chung, Tae Young; Sim, Jae Young; Kim, Chang-Su.

In: IEEE Transactions on Multimedia, Vol. 15, No. 1, 6331534, 01.01.2013, p. 56-69.

Research output: Contribution to journalArticle

Jung, Il Lyong ; Chung, Tae Young ; Sim, Jae Young ; Kim, Chang-Su. / Consistent stereo matching under varying radiometric conditions. In: IEEE Transactions on Multimedia. 2013 ; Vol. 15, No. 1. pp. 56-69.
@article{c8ed3daa9fcd43dcb9cd7bbb14cb7cc3,
title = "Consistent stereo matching under varying radiometric conditions",
abstract = "A consistent stereo matching (CSM) algorithm under varying radiometric conditions, such as lighting and exposure variations, for intermediate view synthesis is proposed in this work. First, we transform the colors of stereo images adaptively so that they are similar at corresponding pixels. Since the correspondences are generally unknown before stereo matching, we estimate pseudo-disparity vectors by sorting pixels based on the cumulative color histograms and use those pseudo vectors in the color transform. Then, to improve the accuracy of stereo matching, we jointly estimate the disparity maps for virtual intermediate views as well as those for real views, based on the consistency criterion that an object point should have the same disparity through all the views. Specifically, we compute matching costs using the reliability term and aggregate the costs to obtain initial disparity maps. We then refine the initial disparity maps by minimizing an energy function, which includes the consistency term. Experimental results show that the proposed CSM algorithm significantly reduces the error rate of disparity estimation under different radiometric conditions and synthesizes high quality intermediate views.",
keywords = "Color similarity, color transform, consistency criterion, forward mapping, intermediate view synthesis, inverse mapping, stereo matching",
author = "Jung, {Il Lyong} and Chung, {Tae Young} and Sim, {Jae Young} and Chang-Su Kim",
year = "2013",
month = "1",
day = "1",
doi = "10.1109/TMM.2012.2225041",
language = "English",
volume = "15",
pages = "56--69",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Consistent stereo matching under varying radiometric conditions

AU - Jung, Il Lyong

AU - Chung, Tae Young

AU - Sim, Jae Young

AU - Kim, Chang-Su

PY - 2013/1/1

Y1 - 2013/1/1

N2 - A consistent stereo matching (CSM) algorithm under varying radiometric conditions, such as lighting and exposure variations, for intermediate view synthesis is proposed in this work. First, we transform the colors of stereo images adaptively so that they are similar at corresponding pixels. Since the correspondences are generally unknown before stereo matching, we estimate pseudo-disparity vectors by sorting pixels based on the cumulative color histograms and use those pseudo vectors in the color transform. Then, to improve the accuracy of stereo matching, we jointly estimate the disparity maps for virtual intermediate views as well as those for real views, based on the consistency criterion that an object point should have the same disparity through all the views. Specifically, we compute matching costs using the reliability term and aggregate the costs to obtain initial disparity maps. We then refine the initial disparity maps by minimizing an energy function, which includes the consistency term. Experimental results show that the proposed CSM algorithm significantly reduces the error rate of disparity estimation under different radiometric conditions and synthesizes high quality intermediate views.

AB - A consistent stereo matching (CSM) algorithm under varying radiometric conditions, such as lighting and exposure variations, for intermediate view synthesis is proposed in this work. First, we transform the colors of stereo images adaptively so that they are similar at corresponding pixels. Since the correspondences are generally unknown before stereo matching, we estimate pseudo-disparity vectors by sorting pixels based on the cumulative color histograms and use those pseudo vectors in the color transform. Then, to improve the accuracy of stereo matching, we jointly estimate the disparity maps for virtual intermediate views as well as those for real views, based on the consistency criterion that an object point should have the same disparity through all the views. Specifically, we compute matching costs using the reliability term and aggregate the costs to obtain initial disparity maps. We then refine the initial disparity maps by minimizing an energy function, which includes the consistency term. Experimental results show that the proposed CSM algorithm significantly reduces the error rate of disparity estimation under different radiometric conditions and synthesizes high quality intermediate views.

KW - Color similarity

KW - color transform

KW - consistency criterion

KW - forward mapping

KW - intermediate view synthesis

KW - inverse mapping

KW - stereo matching

UR - http://www.scopus.com/inward/record.url?scp=84871394168&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871394168&partnerID=8YFLogxK

U2 - 10.1109/TMM.2012.2225041

DO - 10.1109/TMM.2012.2225041

M3 - Article

AN - SCOPUS:84871394168

VL - 15

SP - 56

EP - 69

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 1

M1 - 6331534

ER -