Serial exploration of faces: comparing vision and touch.

Research output: Contribution to journalArticle

Abstract

Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

Original languageEnglish
JournalJournal of Vision
Volume12
Issue number1
Publication statusPublished - 2012 Dec 1
Externally publishedYes

Fingerprint

Touch
Facial Recognition

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Serial exploration of faces : comparing vision and touch. / Dopjans, Lisa; Bülthoff, Heinrich H.; Wallraven, Christian.

In: Journal of Vision, Vol. 12, No. 1, 01.12.2012.

Research output: Contribution to journalArticle

@article{f5ffeee8727e43eba03f5fb056a8246e,
title = "Serial exploration of faces: comparing vision and touch.",
abstract = "Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.",
author = "Lisa Dopjans and B{\"u}lthoff, {Heinrich H.} and Christian Wallraven",
year = "2012",
month = "12",
day = "1",
language = "English",
volume = "12",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "1",

}

TY - JOUR

T1 - Serial exploration of faces

T2 - comparing vision and touch.

AU - Dopjans, Lisa

AU - Bülthoff, Heinrich H.

AU - Wallraven, Christian

PY - 2012/12/1

Y1 - 2012/12/1

N2 - Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

AB - Even though we can recognize faces by touch surprisingly well, haptic face recognition performance is still worse than for visual exploration. One possibility for this performance difference might be due to different encoding strategies in the two modalities, namely, holistic encoding in vision versus serial encoding in haptics. Here, we tested this hypothesis by promoting serial encoding in vision, using a novel, gaze-restricted display that limited the effective field of view in vision to resemble that of haptic exploration. First, we compared haptic with gaze-restricted and unrestricted visual face recognition. Second, we used the face inversion paradigm to assess how encoding differences might affect processing strategies (featural vs. holistic). By promoting serial encoding in vision, we found equal face recognition performance in vision and haptics with a clear switch from holistic to featural processing, suggesting that performance differences in visual and haptic face recognition are due to modality-specific encoding strategies.

UR - http://www.scopus.com/inward/record.url?scp=84891721669&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84891721669&partnerID=8YFLogxK

M3 - Article

C2 - 22235145

VL - 12

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 1

ER -