Recognizing conversational expressions using latent dynamic conditional random fields

Research output: Contribution to conferencePaper

Abstract

Facial expressions are one of the most important elements for our social interaction. Automatic processing and recognition of facial expressions is hence one of the core areas in computer vision, computer graphics, and social signal processing. Conditional Random Fields (CRFs) and their extensions are widely used for recognizing facial expressions. Most research in this area, however, is done either with a limited set of emotional expressions (such as the six universal expressions), or it concentrates on extracting facial action units (individual muscle movements) from video sequences. Little research has been conducted to analyze the complex facial movements that occur in conversational contexts. Conversational expressions such as 'agree', 'disagree', 'thinking', 'looking confused', however, form an integral part of non-verbal communication and systems that can automatically parse and understand such expressions are a key ingredient for the development of efficient human-computer interaction systems. Since conversational expressions may consists of several sub-expressions and contain complex dynamics, however, standard CRF approaches are not suited for the task. In this paper, we conduct a detailed comparison of CRFs and Latent Dynamic Conditional Random Fields (LDCRFs) for recognizing complex conversational expressions. We show the importance of modeling sub-expression dynamics and discuss challenges for applying LDCRFs to recognize a large set of conversational expressions.

Original languageEnglish
Pages697-701
Number of pages5
DOIs
Publication statusPublished - 2013
Event2013 2nd IAPR Asian Conference on Pattern Recognition, ACPR 2013 - Naha, Okinawa, Japan
Duration: 2013 Nov 52013 Nov 8

Other

Other2013 2nd IAPR Asian Conference on Pattern Recognition, ACPR 2013
CountryJapan
CityNaha, Okinawa
Period13/11/513/11/8

Keywords

  • Facial Expression Analysis
  • Human Computer Interaction
  • Sequence Modeling

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Recognizing conversational expressions using latent dynamic conditional random fields'. Together they form a unique fingerprint.

  • Cite this

    Hur, D., Wallraven, C., & Lee, S. W. (2013). Recognizing conversational expressions using latent dynamic conditional random fields. 697-701. Paper presented at 2013 2nd IAPR Asian Conference on Pattern Recognition, ACPR 2013, Naha, Okinawa, Japan. https://doi.org/10.1109/ACPR.2013.98