The contribution of different facial regions to the recognition of conversational expressions

Manfred Nusseck, Douglas W. Cunningham, Christian Wallraven, Heinrich Bulthoff

Research output: Contribution to journalArticle

69 Citations (Scopus)

Abstract

The human face is an important and complex communication channel. Humans can, however, easily read in a face not only identity information but also facial expressions with high accuracy. Here, we present the results of four psychophysical experiments in which we systematically manipulated certain facial areas in video sequences of nine conversational expressions to investigate recognition performance and its dependency on the motions of different facial parts. The results help to demonstrate what information is perceptually necessary and sufficient to recognize the different facial expressions. Subsequent analyses of the facial movements and correlation with recognition performance show that, for some expressions, one individual facial region can represent the whole expression. In other cases, the interaction of more than one facial area is needed to clarify the expression. The full set of results is used to develop a systematic description of the roles of different facial parts in the visual perception of conversational facial expressions.

Original languageEnglish
Article number1
JournalJournal of Vision
Volume8
Issue number8
DOIs
Publication statusPublished - 2008 Jun 2
Externally publishedYes

Fingerprint

Facial Expression
Visual Perception
Communication
Recognition (Psychology)

Keywords

  • Conversational expressions
  • Expression recognition
  • Faces
  • Facial motions

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

The contribution of different facial regions to the recognition of conversational expressions. / Nusseck, Manfred; Cunningham, Douglas W.; Wallraven, Christian; Bulthoff, Heinrich.

In: Journal of Vision, Vol. 8, No. 8, 1, 02.06.2008.

Research output: Contribution to journalArticle

@article{5136bf364179430b884278f31cbdc9a1,
title = "The contribution of different facial regions to the recognition of conversational expressions",
abstract = "The human face is an important and complex communication channel. Humans can, however, easily read in a face not only identity information but also facial expressions with high accuracy. Here, we present the results of four psychophysical experiments in which we systematically manipulated certain facial areas in video sequences of nine conversational expressions to investigate recognition performance and its dependency on the motions of different facial parts. The results help to demonstrate what information is perceptually necessary and sufficient to recognize the different facial expressions. Subsequent analyses of the facial movements and correlation with recognition performance show that, for some expressions, one individual facial region can represent the whole expression. In other cases, the interaction of more than one facial area is needed to clarify the expression. The full set of results is used to develop a systematic description of the roles of different facial parts in the visual perception of conversational facial expressions.",
keywords = "Conversational expressions, Expression recognition, Faces, Facial motions",
author = "Manfred Nusseck and Cunningham, {Douglas W.} and Christian Wallraven and Heinrich Bulthoff",
year = "2008",
month = "6",
day = "2",
doi = "10.1167/8.8.1",
language = "English",
volume = "8",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "8",

}

TY - JOUR

T1 - The contribution of different facial regions to the recognition of conversational expressions

AU - Nusseck, Manfred

AU - Cunningham, Douglas W.

AU - Wallraven, Christian

AU - Bulthoff, Heinrich

PY - 2008/6/2

Y1 - 2008/6/2

N2 - The human face is an important and complex communication channel. Humans can, however, easily read in a face not only identity information but also facial expressions with high accuracy. Here, we present the results of four psychophysical experiments in which we systematically manipulated certain facial areas in video sequences of nine conversational expressions to investigate recognition performance and its dependency on the motions of different facial parts. The results help to demonstrate what information is perceptually necessary and sufficient to recognize the different facial expressions. Subsequent analyses of the facial movements and correlation with recognition performance show that, for some expressions, one individual facial region can represent the whole expression. In other cases, the interaction of more than one facial area is needed to clarify the expression. The full set of results is used to develop a systematic description of the roles of different facial parts in the visual perception of conversational facial expressions.

AB - The human face is an important and complex communication channel. Humans can, however, easily read in a face not only identity information but also facial expressions with high accuracy. Here, we present the results of four psychophysical experiments in which we systematically manipulated certain facial areas in video sequences of nine conversational expressions to investigate recognition performance and its dependency on the motions of different facial parts. The results help to demonstrate what information is perceptually necessary and sufficient to recognize the different facial expressions. Subsequent analyses of the facial movements and correlation with recognition performance show that, for some expressions, one individual facial region can represent the whole expression. In other cases, the interaction of more than one facial area is needed to clarify the expression. The full set of results is used to develop a systematic description of the roles of different facial parts in the visual perception of conversational facial expressions.

KW - Conversational expressions

KW - Expression recognition

KW - Faces

KW - Facial motions

UR - http://www.scopus.com/inward/record.url?scp=44449100126&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44449100126&partnerID=8YFLogxK

U2 - 10.1167/8.8.1

DO - 10.1167/8.8.1

M3 - Article

C2 - 18831624

AN - SCOPUS:44449100126

VL - 8

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 8

M1 - 1

ER -