Serial exploration of faces: Comparing vision and touch

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalJournal of Vision
Volume12
Issue number1
DOIs
Publication statusPublished - 2012 May 24

Fingerprint

Touch
Facial Recognition

Keywords

  • Face processing strategies
  • Face recognition
  • Haptic processing

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Serial exploration of faces : Comparing vision and touch. / Dopjans, Lisa; Bulthoff, Heinrich; Wallraven, Christian.

In: Journal of Vision, Vol. 12, No. 1, 24.05.2012, p. 1-14.

Research output: Contribution to journalArticle

@article{37761ebd387849f481df4ad64fc2aa62,
title = "Serial exploration of faces: Comparing vision and touch",
abstract = "Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.",
keywords = "Face processing strategies, Face recognition, Haptic processing",
author = "Lisa Dopjans and Heinrich Bulthoff and Christian Wallraven",
year = "2012",
month = "5",
day = "24",
doi = "10.1167/12.1.6",
language = "English",
volume = "12",
pages = "1--14",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "1",

}

TY - JOUR

T1 - Serial exploration of faces

T2 - Comparing vision and touch

AU - Dopjans, Lisa

AU - Bulthoff, Heinrich

AU - Wallraven, Christian

PY - 2012/5/24

Y1 - 2012/5/24

N2 - Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

AB - Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

KW - Face processing strategies

KW - Face recognition

KW - Haptic processing

UR - http://www.scopus.com/inward/record.url?scp=84862111198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862111198&partnerID=8YFLogxK

U2 - 10.1167/12.1.6

DO - 10.1167/12.1.6

M3 - Article

C2 - 22235145

AN - SCOPUS:84862111198

VL - 12

SP - 1

EP - 14

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 1

ER -