A virtual mouse interface with a two-layered Bayesian network

Myung Cheol Roh, Dongoh Kang, Sungju Huh, Seong Whan Lee

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

During the last decade, many natural interaction methods between human and computer have been introduced. They were developed for substitutions of keyboard and mouse devices so that they provide convenient interfaces. Recently, many studies on vision based gestural control methods for Human-Computer Interaction (HCI) have been attracted attention because of their convenience and simpleness. Two of the key issues in these kinds of interfaces are robustness and real-time processing. This paper presents a hand gesture based virtual mouse interface and Two-layer Bayesian Network (TBN) for robust hand gesture recognition in real-time. The TBN provides an efficient framework to infer hand postures and gestures not only from information at the current time frame, but also from the preceding and following information, so that it compensates for erroneous postures and its locations under cluttered background environment. Experiments demonstrated that the proposed model recognized hand gestures with a recognition rate of 93.76 % and 85.15 % on simple and cluttered background video data, respectively, and outperformed previous methods: Hidden Markov Model (HMM), Finite State Machine (FSM).

Original languageEnglish
Pages (from-to)1615-1638
Number of pages24
JournalMultimedia Tools and Applications
Volume76
Issue number2
DOIs
Publication statusPublished - 2017 Jan 1

Fingerprint

Bayesian networks
Gesture recognition
Finite automata
Hidden Markov models
Human computer interaction
Substitution reactions
Processing
Experiments

Keywords

  • Hand gesture recognition
  • Two-layer Bayesian network
  • Virtual mouse interface

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

A virtual mouse interface with a two-layered Bayesian network. / Roh, Myung Cheol; Kang, Dongoh; Huh, Sungju; Lee, Seong Whan.

In: Multimedia Tools and Applications, Vol. 76, No. 2, 01.01.2017, p. 1615-1638.

Research output: Contribution to journalArticle

Roh, Myung Cheol ; Kang, Dongoh ; Huh, Sungju ; Lee, Seong Whan. / A virtual mouse interface with a two-layered Bayesian network. In: Multimedia Tools and Applications. 2017 ; Vol. 76, No. 2. pp. 1615-1638.
@article{bdc30ebcaaba45d6a6b0445d94ab9ca9,
title = "A virtual mouse interface with a two-layered Bayesian network",
abstract = "During the last decade, many natural interaction methods between human and computer have been introduced. They were developed for substitutions of keyboard and mouse devices so that they provide convenient interfaces. Recently, many studies on vision based gestural control methods for Human-Computer Interaction (HCI) have been attracted attention because of their convenience and simpleness. Two of the key issues in these kinds of interfaces are robustness and real-time processing. This paper presents a hand gesture based virtual mouse interface and Two-layer Bayesian Network (TBN) for robust hand gesture recognition in real-time. The TBN provides an efficient framework to infer hand postures and gestures not only from information at the current time frame, but also from the preceding and following information, so that it compensates for erroneous postures and its locations under cluttered background environment. Experiments demonstrated that the proposed model recognized hand gestures with a recognition rate of 93.76 {\%} and 85.15 {\%} on simple and cluttered background video data, respectively, and outperformed previous methods: Hidden Markov Model (HMM), Finite State Machine (FSM).",
keywords = "Hand gesture recognition, Two-layer Bayesian network, Virtual mouse interface",
author = "Roh, {Myung Cheol} and Dongoh Kang and Sungju Huh and Lee, {Seong Whan}",
year = "2017",
month = "1",
day = "1",
doi = "10.1007/s11042-015-3144-x",
language = "English",
volume = "76",
pages = "1615--1638",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "2",

}

TY - JOUR

T1 - A virtual mouse interface with a two-layered Bayesian network

AU - Roh, Myung Cheol

AU - Kang, Dongoh

AU - Huh, Sungju

AU - Lee, Seong Whan

PY - 2017/1/1

Y1 - 2017/1/1

N2 - During the last decade, many natural interaction methods between human and computer have been introduced. They were developed for substitutions of keyboard and mouse devices so that they provide convenient interfaces. Recently, many studies on vision based gestural control methods for Human-Computer Interaction (HCI) have been attracted attention because of their convenience and simpleness. Two of the key issues in these kinds of interfaces are robustness and real-time processing. This paper presents a hand gesture based virtual mouse interface and Two-layer Bayesian Network (TBN) for robust hand gesture recognition in real-time. The TBN provides an efficient framework to infer hand postures and gestures not only from information at the current time frame, but also from the preceding and following information, so that it compensates for erroneous postures and its locations under cluttered background environment. Experiments demonstrated that the proposed model recognized hand gestures with a recognition rate of 93.76 % and 85.15 % on simple and cluttered background video data, respectively, and outperformed previous methods: Hidden Markov Model (HMM), Finite State Machine (FSM).

AB - During the last decade, many natural interaction methods between human and computer have been introduced. They were developed for substitutions of keyboard and mouse devices so that they provide convenient interfaces. Recently, many studies on vision based gestural control methods for Human-Computer Interaction (HCI) have been attracted attention because of their convenience and simpleness. Two of the key issues in these kinds of interfaces are robustness and real-time processing. This paper presents a hand gesture based virtual mouse interface and Two-layer Bayesian Network (TBN) for robust hand gesture recognition in real-time. The TBN provides an efficient framework to infer hand postures and gestures not only from information at the current time frame, but also from the preceding and following information, so that it compensates for erroneous postures and its locations under cluttered background environment. Experiments demonstrated that the proposed model recognized hand gestures with a recognition rate of 93.76 % and 85.15 % on simple and cluttered background video data, respectively, and outperformed previous methods: Hidden Markov Model (HMM), Finite State Machine (FSM).

KW - Hand gesture recognition

KW - Two-layer Bayesian network

KW - Virtual mouse interface

UR - http://www.scopus.com/inward/record.url?scp=85009511130&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009511130&partnerID=8YFLogxK

U2 - 10.1007/s11042-015-3144-x

DO - 10.1007/s11042-015-3144-x

M3 - Article

VL - 76

SP - 1615

EP - 1638

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 2

ER -