How are three-dimensional objects represented in the brain?

Heinrich Bulthoff, S. Y. Edelman, M. J. Tarr

Research output: Contribution to journalArticle

206 Citations (Scopus)

Abstract

In this report we discuss a variety of psychophysical experiments that explore different aspects of the problem of object recognition and representation in human vision. In all experiments, subjects were presented with realistically rendered images of computer-generated 3D objects, with tight control over stimulus shape, surface properties, illumination, and viewpoint, as well as subjects' prior exposure to the stimulus objects. Contrary to the predictions of the paradigmatic theory of recognition, which holds that object representations are viewpoint invariant, performance in all experiments was consistently viewpoint dependent, was only partially aided by binocular stereo and other depth information, was specific to viewpoints that were familiar, and was systematically disrupted by rotation in depth more than by deforming the 2D images of the stimuli. The emerging concept of multiple-views representation supported by these results is consistent with recently advanced computational theories of recognition based on view interpolation. Moreover, in several simulated experiments employing the same stimuli used in experiments with human subjects, models based on multiple- views representations replicated many of the psychophysical results concerning the observed pattern of human performance.

Original languageEnglish
Pages (from-to)247-260
Number of pages14
JournalCerebral Cortex
Volume5
Issue number3
Publication statusPublished - 1995 Jan 1
Externally publishedYes

Fingerprint

Brain
Surface Properties
Lighting

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Bulthoff, H., Edelman, S. Y., & Tarr, M. J. (1995). How are three-dimensional objects represented in the brain? Cerebral Cortex, 5(3), 247-260.

How are three-dimensional objects represented in the brain? / Bulthoff, Heinrich; Edelman, S. Y.; Tarr, M. J.

In: Cerebral Cortex, Vol. 5, No. 3, 01.01.1995, p. 247-260.

Research output: Contribution to journalArticle

Bulthoff, H, Edelman, SY & Tarr, MJ 1995, 'How are three-dimensional objects represented in the brain?', Cerebral Cortex, vol. 5, no. 3, pp. 247-260.
Bulthoff, Heinrich ; Edelman, S. Y. ; Tarr, M. J. / How are three-dimensional objects represented in the brain?. In: Cerebral Cortex. 1995 ; Vol. 5, No. 3. pp. 247-260.
@article{13f3d3972b5f4899b47b41db14924381,
title = "How are three-dimensional objects represented in the brain?",
abstract = "In this report we discuss a variety of psychophysical experiments that explore different aspects of the problem of object recognition and representation in human vision. In all experiments, subjects were presented with realistically rendered images of computer-generated 3D objects, with tight control over stimulus shape, surface properties, illumination, and viewpoint, as well as subjects' prior exposure to the stimulus objects. Contrary to the predictions of the paradigmatic theory of recognition, which holds that object representations are viewpoint invariant, performance in all experiments was consistently viewpoint dependent, was only partially aided by binocular stereo and other depth information, was specific to viewpoints that were familiar, and was systematically disrupted by rotation in depth more than by deforming the 2D images of the stimuli. The emerging concept of multiple-views representation supported by these results is consistent with recently advanced computational theories of recognition based on view interpolation. Moreover, in several simulated experiments employing the same stimuli used in experiments with human subjects, models based on multiple- views representations replicated many of the psychophysical results concerning the observed pattern of human performance.",
author = "Heinrich Bulthoff and Edelman, {S. Y.} and Tarr, {M. J.}",
year = "1995",
month = "1",
day = "1",
language = "English",
volume = "5",
pages = "247--260",
journal = "Cerebral Cortex",
issn = "1047-3211",
publisher = "Oxford University Press",
number = "3",

}

TY - JOUR

T1 - How are three-dimensional objects represented in the brain?

AU - Bulthoff, Heinrich

AU - Edelman, S. Y.

AU - Tarr, M. J.

PY - 1995/1/1

Y1 - 1995/1/1

N2 - In this report we discuss a variety of psychophysical experiments that explore different aspects of the problem of object recognition and representation in human vision. In all experiments, subjects were presented with realistically rendered images of computer-generated 3D objects, with tight control over stimulus shape, surface properties, illumination, and viewpoint, as well as subjects' prior exposure to the stimulus objects. Contrary to the predictions of the paradigmatic theory of recognition, which holds that object representations are viewpoint invariant, performance in all experiments was consistently viewpoint dependent, was only partially aided by binocular stereo and other depth information, was specific to viewpoints that were familiar, and was systematically disrupted by rotation in depth more than by deforming the 2D images of the stimuli. The emerging concept of multiple-views representation supported by these results is consistent with recently advanced computational theories of recognition based on view interpolation. Moreover, in several simulated experiments employing the same stimuli used in experiments with human subjects, models based on multiple- views representations replicated many of the psychophysical results concerning the observed pattern of human performance.

AB - In this report we discuss a variety of psychophysical experiments that explore different aspects of the problem of object recognition and representation in human vision. In all experiments, subjects were presented with realistically rendered images of computer-generated 3D objects, with tight control over stimulus shape, surface properties, illumination, and viewpoint, as well as subjects' prior exposure to the stimulus objects. Contrary to the predictions of the paradigmatic theory of recognition, which holds that object representations are viewpoint invariant, performance in all experiments was consistently viewpoint dependent, was only partially aided by binocular stereo and other depth information, was specific to viewpoints that were familiar, and was systematically disrupted by rotation in depth more than by deforming the 2D images of the stimuli. The emerging concept of multiple-views representation supported by these results is consistent with recently advanced computational theories of recognition based on view interpolation. Moreover, in several simulated experiments employing the same stimuli used in experiments with human subjects, models based on multiple- views representations replicated many of the psychophysical results concerning the observed pattern of human performance.

UR - http://www.scopus.com/inward/record.url?scp=0029063252&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0029063252&partnerID=8YFLogxK

M3 - Article

C2 - 7613080

AN - SCOPUS:0029063252

VL - 5

SP - 247

EP - 260

JO - Cerebral Cortex

JF - Cerebral Cortex

SN - 1047-3211

IS - 3

ER -