Sign language spotting based on semi-Markov Conditional Random Field

Seong Sik Cho, Hee Deok Yang, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Sign language spotting is the task of detecting the start and end points of signs from continuous data and recognizing the detected signs in the predefined vocabulary. The difficulty with sign language spotting is that instances of signs vary in terms of both motion and shape. Moreover, signs have variable motion in terms of both trajectory and length. Especially, variable sign lengths result in problems with spotting signs in a video sequence, because short signs involve less information and fewer changes than long signs. In this paper, we propose a method for spotting variable lengths signs based on semi-CRF (semi-Markov Conditional Random Field). We performed experiments with ASL (American Sign Language) and KSL (Korean Sign Language) datasets of continuous sign sentences to demonstrate the efficiency of the proposed method. Experimental results showed that the proposed method outperforms both HMM and CRF.

Original languageEnglish
Title of host publication2009 Workshop on Applications of Computer Vision, WACV 2009
DOIs
Publication statusPublished - 2009
Event2009 Workshop on Applications of Computer Vision, WACV 2009 - Snowbird, UT, United States
Duration: 2009 Dec 72009 Dec 8

Publication series

Name2009 Workshop on Applications of Computer Vision, WACV 2009

Other

Other2009 Workshop on Applications of Computer Vision, WACV 2009
CountryUnited States
CitySnowbird, UT
Period09/12/709/12/8

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Sign language spotting based on semi-Markov Conditional Random Field'. Together they form a unique fingerprint.

  • Cite this

    Cho, S. S., Yang, H. D., & Lee, S. W. (2009). Sign language spotting based on semi-Markov Conditional Random Field. In 2009 Workshop on Applications of Computer Vision, WACV 2009 [5403109] (2009 Workshop on Applications of Computer Vision, WACV 2009). https://doi.org/10.1109/WACV.2009.5403109