Stimulus-specific effects in face recognition over changes in viewpoint

Alice J. O'Toole, Shimon Edelman, Heinrich Bulthoff

Research output: Contribution to journalArticle

119 Citations (Scopus)

Abstract

Individual faces vary considerably in both the quality and quantity of the information they contain for recognition and for viewpoint generalization. In the present study, we assessed the typicality, recognizability, and viewpoint generalizability of individual faces using data from both human observers and from a computational model of face recognition across viewpoint change. The two-stage computational model incorporated a viewpoint alignment operation and a recognition-by-interpolation operation. An interesting aspect of this particular model is that the effects of typicality it predicts at the alignment and recognition stages dissociate, such that face typicality is beneficial for the success of the alignment process, but is adverse for the success of the recognition process. We applied a factor analysis to the covariance data for the human- and model-derived face measures across the different viewpoints and found two axes that appeared consistently across all viewpoints. Projection scores for individual faces on these axes (i.e. the extent to which a face's 'performance profile' matched the pattern of human- and model-derived scores on that axis), correlated across viewpoint changes to a much higher degree than did the raw recognizability scores of the faces. These results suggest that the stimulus information captured in the model measures may underlie distinct and dissociable aspects of the recognizability of individual faces across viewpoint change.

Original languageEnglish
Pages (from-to)2351-2363
Number of pages13
JournalVision Research
Volume38
Issue number15-16
DOIs
Publication statusPublished - 1998 Aug 1
Externally publishedYes

Fingerprint

Statistical Factor Analysis
Facial Recognition

Keywords

  • Face recognition
  • Human
  • Model
  • Viewpoint change

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Stimulus-specific effects in face recognition over changes in viewpoint. / O'Toole, Alice J.; Edelman, Shimon; Bulthoff, Heinrich.

In: Vision Research, Vol. 38, No. 15-16, 01.08.1998, p. 2351-2363.

Research output: Contribution to journalArticle

O'Toole, Alice J. ; Edelman, Shimon ; Bulthoff, Heinrich. / Stimulus-specific effects in face recognition over changes in viewpoint. In: Vision Research. 1998 ; Vol. 38, No. 15-16. pp. 2351-2363.
@article{053e636b01974a3b98da2a48f587d0e1,
title = "Stimulus-specific effects in face recognition over changes in viewpoint",
abstract = "Individual faces vary considerably in both the quality and quantity of the information they contain for recognition and for viewpoint generalization. In the present study, we assessed the typicality, recognizability, and viewpoint generalizability of individual faces using data from both human observers and from a computational model of face recognition across viewpoint change. The two-stage computational model incorporated a viewpoint alignment operation and a recognition-by-interpolation operation. An interesting aspect of this particular model is that the effects of typicality it predicts at the alignment and recognition stages dissociate, such that face typicality is beneficial for the success of the alignment process, but is adverse for the success of the recognition process. We applied a factor analysis to the covariance data for the human- and model-derived face measures across the different viewpoints and found two axes that appeared consistently across all viewpoints. Projection scores for individual faces on these axes (i.e. the extent to which a face's 'performance profile' matched the pattern of human- and model-derived scores on that axis), correlated across viewpoint changes to a much higher degree than did the raw recognizability scores of the faces. These results suggest that the stimulus information captured in the model measures may underlie distinct and dissociable aspects of the recognizability of individual faces across viewpoint change.",
keywords = "Face recognition, Human, Model, Viewpoint change",
author = "O'Toole, {Alice J.} and Shimon Edelman and Heinrich Bulthoff",
year = "1998",
month = "8",
day = "1",
doi = "10.1016/S0042-6989(98)00042-X",
language = "English",
volume = "38",
pages = "2351--2363",
journal = "Vision Research",
issn = "0042-6989",
publisher = "Elsevier Limited",
number = "15-16",

}

TY - JOUR

T1 - Stimulus-specific effects in face recognition over changes in viewpoint

AU - O'Toole, Alice J.

AU - Edelman, Shimon

AU - Bulthoff, Heinrich

PY - 1998/8/1

Y1 - 1998/8/1

N2 - Individual faces vary considerably in both the quality and quantity of the information they contain for recognition and for viewpoint generalization. In the present study, we assessed the typicality, recognizability, and viewpoint generalizability of individual faces using data from both human observers and from a computational model of face recognition across viewpoint change. The two-stage computational model incorporated a viewpoint alignment operation and a recognition-by-interpolation operation. An interesting aspect of this particular model is that the effects of typicality it predicts at the alignment and recognition stages dissociate, such that face typicality is beneficial for the success of the alignment process, but is adverse for the success of the recognition process. We applied a factor analysis to the covariance data for the human- and model-derived face measures across the different viewpoints and found two axes that appeared consistently across all viewpoints. Projection scores for individual faces on these axes (i.e. the extent to which a face's 'performance profile' matched the pattern of human- and model-derived scores on that axis), correlated across viewpoint changes to a much higher degree than did the raw recognizability scores of the faces. These results suggest that the stimulus information captured in the model measures may underlie distinct and dissociable aspects of the recognizability of individual faces across viewpoint change.

AB - Individual faces vary considerably in both the quality and quantity of the information they contain for recognition and for viewpoint generalization. In the present study, we assessed the typicality, recognizability, and viewpoint generalizability of individual faces using data from both human observers and from a computational model of face recognition across viewpoint change. The two-stage computational model incorporated a viewpoint alignment operation and a recognition-by-interpolation operation. An interesting aspect of this particular model is that the effects of typicality it predicts at the alignment and recognition stages dissociate, such that face typicality is beneficial for the success of the alignment process, but is adverse for the success of the recognition process. We applied a factor analysis to the covariance data for the human- and model-derived face measures across the different viewpoints and found two axes that appeared consistently across all viewpoints. Projection scores for individual faces on these axes (i.e. the extent to which a face's 'performance profile' matched the pattern of human- and model-derived scores on that axis), correlated across viewpoint changes to a much higher degree than did the raw recognizability scores of the faces. These results suggest that the stimulus information captured in the model measures may underlie distinct and dissociable aspects of the recognizability of individual faces across viewpoint change.

KW - Face recognition

KW - Human

KW - Model

KW - Viewpoint change

UR - http://www.scopus.com/inward/record.url?scp=0031826913&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031826913&partnerID=8YFLogxK

U2 - 10.1016/S0042-6989(98)00042-X

DO - 10.1016/S0042-6989(98)00042-X

M3 - Article

C2 - 9798004

AN - SCOPUS:0031826913

VL - 38

SP - 2351

EP - 2363

JO - Vision Research

JF - Vision Research

SN - 0042-6989

IS - 15-16

ER -