Augmented reality with high frame rate for low computational power devices

Hyung Seok Jang, Jae Yun Jeong, Young Hyun Kim, Yeo Jin Yoon, Sung-Jea Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In the conventional Augmented Reality (AR) systems, three main tasks are sequentially performed: image acquisition, camera pose tracking and rendering. Among these tasks, the camera pose tracking occupies the largest proportion of total processing time. Thus, frame rate can be reduced in small mobile devices when the tracking processing time exceeds the image acquisition time interval needed for desired frame rate. Moreover, the temporal jitter can be introduced due to the irregular tracking processing time. In this paper, we present a new framework for AR that can achieve the high frame rate and reduce the temporal jitter. In the proposed method, the three main tasks of AR are performed in parallel. This enables the image acquisition and rendering thread to work independently with the tracking thread so to prevent frame loss and temporal jitter. The tracking thread calculates the camera pose of the coarsely selected frames. For the unselected frames, the parabolic motion model is applied. Experimental results indicate that the proposed system outperforms conventional methods in terms of frame rate and temporal jitter.

Original languageEnglish
Title of host publicationDigest of Technical Papers - IEEE International Conference on Consumer Electronics
Pages274-275
Number of pages2
DOIs
Publication statusPublished - 2011 Oct 26
Event1st IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2011 - Berlin, Germany
Duration: 2011 Sep 62011 Sep 8

Other

Other1st IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2011
CountryGermany
CityBerlin
Period11/9/611/9/8

Fingerprint

Augmented reality
Jitter
Image acquisition
Cameras
Processing
Mobile devices

Keywords

  • augmented reality
  • frame rate up conversion
  • mobile devices
  • parabolic motion model
  • smartphone
  • temporal jitter

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering

Cite this

Jang, H. S., Jeong, J. Y., Kim, Y. H., Yoon, Y. J., & Ko, S-J. (2011). Augmented reality with high frame rate for low computational power devices. In Digest of Technical Papers - IEEE International Conference on Consumer Electronics (pp. 274-275). [6031808] https://doi.org/10.1109/ICCE-Berlin.2011.6031808

Augmented reality with high frame rate for low computational power devices. / Jang, Hyung Seok; Jeong, Jae Yun; Kim, Young Hyun; Yoon, Yeo Jin; Ko, Sung-Jea.

Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2011. p. 274-275 6031808.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jang, HS, Jeong, JY, Kim, YH, Yoon, YJ & Ko, S-J 2011, Augmented reality with high frame rate for low computational power devices. in Digest of Technical Papers - IEEE International Conference on Consumer Electronics., 6031808, pp. 274-275, 1st IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin 2011, Berlin, Germany, 11/9/6. https://doi.org/10.1109/ICCE-Berlin.2011.6031808
Jang HS, Jeong JY, Kim YH, Yoon YJ, Ko S-J. Augmented reality with high frame rate for low computational power devices. In Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2011. p. 274-275. 6031808 https://doi.org/10.1109/ICCE-Berlin.2011.6031808
Jang, Hyung Seok ; Jeong, Jae Yun ; Kim, Young Hyun ; Yoon, Yeo Jin ; Ko, Sung-Jea. / Augmented reality with high frame rate for low computational power devices. Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2011. pp. 274-275
@inproceedings{60af316a1458423abc8274db52bca197,
title = "Augmented reality with high frame rate for low computational power devices",
abstract = "In the conventional Augmented Reality (AR) systems, three main tasks are sequentially performed: image acquisition, camera pose tracking and rendering. Among these tasks, the camera pose tracking occupies the largest proportion of total processing time. Thus, frame rate can be reduced in small mobile devices when the tracking processing time exceeds the image acquisition time interval needed for desired frame rate. Moreover, the temporal jitter can be introduced due to the irregular tracking processing time. In this paper, we present a new framework for AR that can achieve the high frame rate and reduce the temporal jitter. In the proposed method, the three main tasks of AR are performed in parallel. This enables the image acquisition and rendering thread to work independently with the tracking thread so to prevent frame loss and temporal jitter. The tracking thread calculates the camera pose of the coarsely selected frames. For the unselected frames, the parabolic motion model is applied. Experimental results indicate that the proposed system outperforms conventional methods in terms of frame rate and temporal jitter.",
keywords = "augmented reality, frame rate up conversion, mobile devices, parabolic motion model, smartphone, temporal jitter",
author = "Jang, {Hyung Seok} and Jeong, {Jae Yun} and Kim, {Young Hyun} and Yoon, {Yeo Jin} and Sung-Jea Ko",
year = "2011",
month = "10",
day = "26",
doi = "10.1109/ICCE-Berlin.2011.6031808",
language = "English",
isbn = "9781457702341",
pages = "274--275",
booktitle = "Digest of Technical Papers - IEEE International Conference on Consumer Electronics",

}

TY - GEN

T1 - Augmented reality with high frame rate for low computational power devices

AU - Jang, Hyung Seok

AU - Jeong, Jae Yun

AU - Kim, Young Hyun

AU - Yoon, Yeo Jin

AU - Ko, Sung-Jea

PY - 2011/10/26

Y1 - 2011/10/26

N2 - In the conventional Augmented Reality (AR) systems, three main tasks are sequentially performed: image acquisition, camera pose tracking and rendering. Among these tasks, the camera pose tracking occupies the largest proportion of total processing time. Thus, frame rate can be reduced in small mobile devices when the tracking processing time exceeds the image acquisition time interval needed for desired frame rate. Moreover, the temporal jitter can be introduced due to the irregular tracking processing time. In this paper, we present a new framework for AR that can achieve the high frame rate and reduce the temporal jitter. In the proposed method, the three main tasks of AR are performed in parallel. This enables the image acquisition and rendering thread to work independently with the tracking thread so to prevent frame loss and temporal jitter. The tracking thread calculates the camera pose of the coarsely selected frames. For the unselected frames, the parabolic motion model is applied. Experimental results indicate that the proposed system outperforms conventional methods in terms of frame rate and temporal jitter.

AB - In the conventional Augmented Reality (AR) systems, three main tasks are sequentially performed: image acquisition, camera pose tracking and rendering. Among these tasks, the camera pose tracking occupies the largest proportion of total processing time. Thus, frame rate can be reduced in small mobile devices when the tracking processing time exceeds the image acquisition time interval needed for desired frame rate. Moreover, the temporal jitter can be introduced due to the irregular tracking processing time. In this paper, we present a new framework for AR that can achieve the high frame rate and reduce the temporal jitter. In the proposed method, the three main tasks of AR are performed in parallel. This enables the image acquisition and rendering thread to work independently with the tracking thread so to prevent frame loss and temporal jitter. The tracking thread calculates the camera pose of the coarsely selected frames. For the unselected frames, the parabolic motion model is applied. Experimental results indicate that the proposed system outperforms conventional methods in terms of frame rate and temporal jitter.

KW - augmented reality

KW - frame rate up conversion

KW - mobile devices

KW - parabolic motion model

KW - smartphone

KW - temporal jitter

UR - http://www.scopus.com/inward/record.url?scp=80054802106&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80054802106&partnerID=8YFLogxK

U2 - 10.1109/ICCE-Berlin.2011.6031808

DO - 10.1109/ICCE-Berlin.2011.6031808

M3 - Conference contribution

AN - SCOPUS:80054802106

SN - 9781457702341

SP - 274

EP - 275

BT - Digest of Technical Papers - IEEE International Conference on Consumer Electronics

ER -