Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality

Euijai Ahn, Sungkil Lee, Jeonghyun Kim

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Augmented reality (AR) “augments” virtual information over the real-world medium and is emerging as an important type of an information visualization technique. As such, the visibility and readability of the augmented information must be as high as possible amidst the dynamically changing real-world surrounding and background. In this work, we present a technique based on image saliency analysis to improve the conspicuity of the foreground augmentation to the background real-world medium by adjusting the local brightness contrast. The proposed technique is implemented on a mobile platform considering the usage nature of AR. The saliency computation is carried out for the augmented object’s representative color rather than all the pixels, and searching and adjusting over only a discrete number of brightness levels to produce the highest contrast saliency, thereby making real-time computation possible. While the resulting imagery may not be optimal due to such a simplification, our tests showed that the visibility was still significantly improved without much difference to the “optimal” ground truth in terms of correctly perceiving and recognizing the augmented information. In addition, we also present another experiment that explores in what fashion the proposed algorithm can be applied in actual AR applications. The results suggested that the users clearly preferred the automatic contrast modulation upon large movements in the scenery.

Original languageEnglish
Pages (from-to)1-18
Number of pages18
JournalVirtual Reality
DOIs
Publication statusAccepted/In press - 2017 Jul 5

Fingerprint

Augmented reality
Visibility
Luminance
Image analysis
Visualization
Pixels
Modulation
Color
Experiments

Keywords

  • Augmented reality
  • Contrast
  • Human perception and performance
  • Saliency
  • See-through display

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this

Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality. / Ahn, Euijai; Lee, Sungkil; Kim, Jeonghyun.

In: Virtual Reality, 05.07.2017, p. 1-18.

Research output: Contribution to journalArticle

@article{3b56f93c8b064f8fa1023cec42ac53ab,
title = "Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality",
abstract = "Augmented reality (AR) “augments” virtual information over the real-world medium and is emerging as an important type of an information visualization technique. As such, the visibility and readability of the augmented information must be as high as possible amidst the dynamically changing real-world surrounding and background. In this work, we present a technique based on image saliency analysis to improve the conspicuity of the foreground augmentation to the background real-world medium by adjusting the local brightness contrast. The proposed technique is implemented on a mobile platform considering the usage nature of AR. The saliency computation is carried out for the augmented object’s representative color rather than all the pixels, and searching and adjusting over only a discrete number of brightness levels to produce the highest contrast saliency, thereby making real-time computation possible. While the resulting imagery may not be optimal due to such a simplification, our tests showed that the visibility was still significantly improved without much difference to the “optimal” ground truth in terms of correctly perceiving and recognizing the augmented information. In addition, we also present another experiment that explores in what fashion the proposed algorithm can be applied in actual AR applications. The results suggested that the users clearly preferred the automatic contrast modulation upon large movements in the scenery.",
keywords = "Augmented reality, Contrast, Human perception and performance, Saliency, See-through display",
author = "Euijai Ahn and Sungkil Lee and Jeonghyun Kim",
year = "2017",
month = "7",
day = "5",
doi = "10.1007/s10055-017-0319-y",
language = "English",
pages = "1--18",
journal = "Virtual Reality",
issn = "1359-4338",
publisher = "Springer London",

}

TY - JOUR

T1 - Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality

AU - Ahn, Euijai

AU - Lee, Sungkil

AU - Kim, Jeonghyun

PY - 2017/7/5

Y1 - 2017/7/5

N2 - Augmented reality (AR) “augments” virtual information over the real-world medium and is emerging as an important type of an information visualization technique. As such, the visibility and readability of the augmented information must be as high as possible amidst the dynamically changing real-world surrounding and background. In this work, we present a technique based on image saliency analysis to improve the conspicuity of the foreground augmentation to the background real-world medium by adjusting the local brightness contrast. The proposed technique is implemented on a mobile platform considering the usage nature of AR. The saliency computation is carried out for the augmented object’s representative color rather than all the pixels, and searching and adjusting over only a discrete number of brightness levels to produce the highest contrast saliency, thereby making real-time computation possible. While the resulting imagery may not be optimal due to such a simplification, our tests showed that the visibility was still significantly improved without much difference to the “optimal” ground truth in terms of correctly perceiving and recognizing the augmented information. In addition, we also present another experiment that explores in what fashion the proposed algorithm can be applied in actual AR applications. The results suggested that the users clearly preferred the automatic contrast modulation upon large movements in the scenery.

AB - Augmented reality (AR) “augments” virtual information over the real-world medium and is emerging as an important type of an information visualization technique. As such, the visibility and readability of the augmented information must be as high as possible amidst the dynamically changing real-world surrounding and background. In this work, we present a technique based on image saliency analysis to improve the conspicuity of the foreground augmentation to the background real-world medium by adjusting the local brightness contrast. The proposed technique is implemented on a mobile platform considering the usage nature of AR. The saliency computation is carried out for the augmented object’s representative color rather than all the pixels, and searching and adjusting over only a discrete number of brightness levels to produce the highest contrast saliency, thereby making real-time computation possible. While the resulting imagery may not be optimal due to such a simplification, our tests showed that the visibility was still significantly improved without much difference to the “optimal” ground truth in terms of correctly perceiving and recognizing the augmented information. In addition, we also present another experiment that explores in what fashion the proposed algorithm can be applied in actual AR applications. The results suggested that the users clearly preferred the automatic contrast modulation upon large movements in the scenery.

KW - Augmented reality

KW - Contrast

KW - Human perception and performance

KW - Saliency

KW - See-through display

UR - http://www.scopus.com/inward/record.url?scp=85021779009&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021779009&partnerID=8YFLogxK

U2 - 10.1007/s10055-017-0319-y

DO - 10.1007/s10055-017-0319-y

M3 - Article

AN - SCOPUS:85021779009

SP - 1

EP - 18

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

ER -