Real-time 3D pointing gesture recognition in mobile space

Chang Beom Park, Myung Cheol Roh, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

In this paper, we present a real-time 3D pointing gesture recognition algorithm for natural human-robot interaction (HRI). The recognition errors in previous pointing gesture recognition algorithms are mainly caused by the low performance of the hands tracking module and by the unreliability of the direction estimate itself, therefore our proposed algorithm uses 3D particle filter for achieving reliability in hand tracking and cascade hidden Markov model (HMM) for a robust estimate for the pointing direction. When someone enters the field of view of the camera, his or her face and two hands are located and tracked using the particle filters. The first stage HMM takes the hand position estimate and maps it to a more accurate position by modeling the kinematic characteristics of finger pointing. The resulting 3D coordinates are used as an input to the second stage HMM that discriminates pointing gestures from others. Finally the pointing direction is estimated in the case of pointing state. The proposed method can deal with both large and small pointing gestures. The experiment shows better than 89% gesture recognition results and 99% target selection results.

Original languageEnglish
Title of host publication2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008
DOIs
Publication statusPublished - 2008
Event2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008 - Amsterdam, Netherlands
Duration: 2008 Sep 172008 Sep 19

Publication series

Name2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008

Other

Other2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008
CountryNetherlands
CityAmsterdam
Period08/9/1708/9/19

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Real-time 3D pointing gesture recognition in mobile space'. Together they form a unique fingerprint.

  • Cite this

    Park, C. B., Roh, M. C., & Lee, S. W. (2008). Real-time 3D pointing gesture recognition in mobile space. In 2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008 [4813448] (2008 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008). https://doi.org/10.1109/AFGR.2008.4813448