Touchless user interface based on marker detection and tracking for real-time mobile applications

Il Lyong Jung, Nikolay Akatyev, Won Dong Jang, Leonardo Juniti Nomoto, Chang-Su Kim

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

A touchless user interaction system based on marker detection and tracking is proposed for real-time mobile applications. The proposed algorithm can robustly estimate users' control information with a camera on a mobile device, which often has limited hardware resources and is influenced by varying environmental conditions. First, we detect a pre-registered marker based on the normalized correlation coefficient. Then, we track the marker motion by employing the contrast invariant mean-shift algorithm. More specifically, the proposed contrast invariant mean-shift algorithm transforms a candidate frame in order to match its histogram into the histogram of the target frame. It then tracks feature points by performing the mean-shift on both original and transformed candidate frames adaptively. To evaluate the performance of the proposed interaction system, we implement 'Painting', 'Camera' and 'Virtual Keypad' applications. Experimental results demonstrate that the proposed algorithm provides better interaction performance than the conventional method, while demanding lower computational complexity and thus supporting real-time user interaction.

Original languageEnglish
Pages (from-to)851-864
Number of pages14
JournalInternational Journal of Innovative Computing, Information and Control
Volume9
Issue number2
Publication statusPublished - 2013 May 21

Fingerprint

Mobile Applications
User Interface
User interfaces
Mean Shift
Invariant Mean
Real-time
User Interaction
Histogram
Camera
Cameras
Computer keyboards
Feature Point
Painting
Interaction
Mobile devices
Correlation coefficient
Mobile Devices
Low Complexity
Computational complexity
Computational Complexity

Keywords

  • Contrast invariant tracking
  • Mobile user interface
  • Pattern analysis
  • Touchless user interface
  • User interaction

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Information Systems
  • Software
  • Theoretical Computer Science

Cite this

Touchless user interface based on marker detection and tracking for real-time mobile applications. / Jung, Il Lyong; Akatyev, Nikolay; Jang, Won Dong; Nomoto, Leonardo Juniti; Kim, Chang-Su.

In: International Journal of Innovative Computing, Information and Control, Vol. 9, No. 2, 21.05.2013, p. 851-864.

Research output: Contribution to journalArticle

Jung, Il Lyong ; Akatyev, Nikolay ; Jang, Won Dong ; Nomoto, Leonardo Juniti ; Kim, Chang-Su. / Touchless user interface based on marker detection and tracking for real-time mobile applications. In: International Journal of Innovative Computing, Information and Control. 2013 ; Vol. 9, No. 2. pp. 851-864.
@article{e95a893a587c43a19ea38b4b6c6ec438,
title = "Touchless user interface based on marker detection and tracking for real-time mobile applications",
abstract = "A touchless user interaction system based on marker detection and tracking is proposed for real-time mobile applications. The proposed algorithm can robustly estimate users' control information with a camera on a mobile device, which often has limited hardware resources and is influenced by varying environmental conditions. First, we detect a pre-registered marker based on the normalized correlation coefficient. Then, we track the marker motion by employing the contrast invariant mean-shift algorithm. More specifically, the proposed contrast invariant mean-shift algorithm transforms a candidate frame in order to match its histogram into the histogram of the target frame. It then tracks feature points by performing the mean-shift on both original and transformed candidate frames adaptively. To evaluate the performance of the proposed interaction system, we implement 'Painting', 'Camera' and 'Virtual Keypad' applications. Experimental results demonstrate that the proposed algorithm provides better interaction performance than the conventional method, while demanding lower computational complexity and thus supporting real-time user interaction.",
keywords = "Contrast invariant tracking, Mobile user interface, Pattern analysis, Touchless user interface, User interaction",
author = "Jung, {Il Lyong} and Nikolay Akatyev and Jang, {Won Dong} and Nomoto, {Leonardo Juniti} and Chang-Su Kim",
year = "2013",
month = "5",
day = "21",
language = "English",
volume = "9",
pages = "851--864",
journal = "International Journal of Innovative Computing, Information and Control",
issn = "1349-4198",
publisher = "IJICIC Editorial Office",
number = "2",

}

TY - JOUR

T1 - Touchless user interface based on marker detection and tracking for real-time mobile applications

AU - Jung, Il Lyong

AU - Akatyev, Nikolay

AU - Jang, Won Dong

AU - Nomoto, Leonardo Juniti

AU - Kim, Chang-Su

PY - 2013/5/21

Y1 - 2013/5/21

N2 - A touchless user interaction system based on marker detection and tracking is proposed for real-time mobile applications. The proposed algorithm can robustly estimate users' control information with a camera on a mobile device, which often has limited hardware resources and is influenced by varying environmental conditions. First, we detect a pre-registered marker based on the normalized correlation coefficient. Then, we track the marker motion by employing the contrast invariant mean-shift algorithm. More specifically, the proposed contrast invariant mean-shift algorithm transforms a candidate frame in order to match its histogram into the histogram of the target frame. It then tracks feature points by performing the mean-shift on both original and transformed candidate frames adaptively. To evaluate the performance of the proposed interaction system, we implement 'Painting', 'Camera' and 'Virtual Keypad' applications. Experimental results demonstrate that the proposed algorithm provides better interaction performance than the conventional method, while demanding lower computational complexity and thus supporting real-time user interaction.

AB - A touchless user interaction system based on marker detection and tracking is proposed for real-time mobile applications. The proposed algorithm can robustly estimate users' control information with a camera on a mobile device, which often has limited hardware resources and is influenced by varying environmental conditions. First, we detect a pre-registered marker based on the normalized correlation coefficient. Then, we track the marker motion by employing the contrast invariant mean-shift algorithm. More specifically, the proposed contrast invariant mean-shift algorithm transforms a candidate frame in order to match its histogram into the histogram of the target frame. It then tracks feature points by performing the mean-shift on both original and transformed candidate frames adaptively. To evaluate the performance of the proposed interaction system, we implement 'Painting', 'Camera' and 'Virtual Keypad' applications. Experimental results demonstrate that the proposed algorithm provides better interaction performance than the conventional method, while demanding lower computational complexity and thus supporting real-time user interaction.

KW - Contrast invariant tracking

KW - Mobile user interface

KW - Pattern analysis

KW - Touchless user interface

KW - User interaction

UR - http://www.scopus.com/inward/record.url?scp=84877818583&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877818583&partnerID=8YFLogxK

M3 - Article

VL - 9

SP - 851

EP - 864

JO - International Journal of Innovative Computing, Information and Control

JF - International Journal of Innovative Computing, Information and Control

SN - 1349-4198

IS - 2

ER -