Why the visual recognition system might encode the effects of illumination

Michael J. Tarr, Daniel Kersten, Heinrich Bulthoff

Research output: Contribution to journalArticle

68 Citations (Scopus)

Abstract

A key problem in recognition is that the image of an object depends on the lighting conditions. We investigated whether recognition is sensitive to illumination using 3-D objects that were lit from either the left or right, varying both the shading and the cast shadows. In experiments 1 and 2 participants judged whether two sequentially presented objects were the same regardless of illumination. Experiment 1 used six objects that were easily discriminated and that were rendered with cast shadows. While no cost was found in sensitivity, there was a response time cost over a change in lighting direction. Experiment 2 included six additional objects that were similar to the original six objects making recognition more difficult. The objects were rendered with cast shadows, no shadows, and as a control, white shadows. With normal shadows a change in lighting direction produced costs in both sensitivity and response times. With white shadows there was a much larger cost in sensitivity and a comparable cost in response times. Without cast shadows there was no cost in either measure, but the overall performance was poorer. Experiment 3 used a naming task in which names were assigned to six objects rendered with cast shadows. Participants practised identifying the objects in two viewpoints lit from a single lighting direction. Viewpoint and illumination invariance were then tested over new viewpoints and illuminations. Costs in both sensitivity and response time were found for naming the familiar objects in unfamiliar lighting directions regardless of whether the viewpoint was familiar or unfamiliar. Together these results suggest that illumination effects such as shadow edges: (1) affect visual memory; (2) serve the function of making unambigous the three-dimensional shape; and (3) are modeled with respect to object shape, rather than simply encoded in lens of their effects in the image.

Original languageEnglish
Pages (from-to)2259-2275
Number of pages17
JournalVision Research
Volume38
Issue number15-16
DOIs
Publication statusPublished - 1998 Aug 1
Externally publishedYes

Fingerprint

Lighting
Costs and Cost Analysis
Reaction Time
Lenses
Names
Direction compound

Keywords

  • 3-D objects
  • Illumination
  • Visual recognition system

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Why the visual recognition system might encode the effects of illumination. / Tarr, Michael J.; Kersten, Daniel; Bulthoff, Heinrich.

In: Vision Research, Vol. 38, No. 15-16, 01.08.1998, p. 2259-2275.

Research output: Contribution to journalArticle

Tarr, Michael J. ; Kersten, Daniel ; Bulthoff, Heinrich. / Why the visual recognition system might encode the effects of illumination. In: Vision Research. 1998 ; Vol. 38, No. 15-16. pp. 2259-2275.
@article{669828e3f2af461dab85858815acc2b0,
title = "Why the visual recognition system might encode the effects of illumination",
abstract = "A key problem in recognition is that the image of an object depends on the lighting conditions. We investigated whether recognition is sensitive to illumination using 3-D objects that were lit from either the left or right, varying both the shading and the cast shadows. In experiments 1 and 2 participants judged whether two sequentially presented objects were the same regardless of illumination. Experiment 1 used six objects that were easily discriminated and that were rendered with cast shadows. While no cost was found in sensitivity, there was a response time cost over a change in lighting direction. Experiment 2 included six additional objects that were similar to the original six objects making recognition more difficult. The objects were rendered with cast shadows, no shadows, and as a control, white shadows. With normal shadows a change in lighting direction produced costs in both sensitivity and response times. With white shadows there was a much larger cost in sensitivity and a comparable cost in response times. Without cast shadows there was no cost in either measure, but the overall performance was poorer. Experiment 3 used a naming task in which names were assigned to six objects rendered with cast shadows. Participants practised identifying the objects in two viewpoints lit from a single lighting direction. Viewpoint and illumination invariance were then tested over new viewpoints and illuminations. Costs in both sensitivity and response time were found for naming the familiar objects in unfamiliar lighting directions regardless of whether the viewpoint was familiar or unfamiliar. Together these results suggest that illumination effects such as shadow edges: (1) affect visual memory; (2) serve the function of making unambigous the three-dimensional shape; and (3) are modeled with respect to object shape, rather than simply encoded in lens of their effects in the image.",
keywords = "3-D objects, Illumination, Visual recognition system",
author = "Tarr, {Michael J.} and Daniel Kersten and Heinrich Bulthoff",
year = "1998",
month = "8",
day = "1",
doi = "10.1016/S0042-6989(98)00041-8",
language = "English",
volume = "38",
pages = "2259--2275",
journal = "Vision Research",
issn = "0042-6989",
publisher = "Elsevier Limited",
number = "15-16",

}

TY - JOUR

T1 - Why the visual recognition system might encode the effects of illumination

AU - Tarr, Michael J.

AU - Kersten, Daniel

AU - Bulthoff, Heinrich

PY - 1998/8/1

Y1 - 1998/8/1

N2 - A key problem in recognition is that the image of an object depends on the lighting conditions. We investigated whether recognition is sensitive to illumination using 3-D objects that were lit from either the left or right, varying both the shading and the cast shadows. In experiments 1 and 2 participants judged whether two sequentially presented objects were the same regardless of illumination. Experiment 1 used six objects that were easily discriminated and that were rendered with cast shadows. While no cost was found in sensitivity, there was a response time cost over a change in lighting direction. Experiment 2 included six additional objects that were similar to the original six objects making recognition more difficult. The objects were rendered with cast shadows, no shadows, and as a control, white shadows. With normal shadows a change in lighting direction produced costs in both sensitivity and response times. With white shadows there was a much larger cost in sensitivity and a comparable cost in response times. Without cast shadows there was no cost in either measure, but the overall performance was poorer. Experiment 3 used a naming task in which names were assigned to six objects rendered with cast shadows. Participants practised identifying the objects in two viewpoints lit from a single lighting direction. Viewpoint and illumination invariance were then tested over new viewpoints and illuminations. Costs in both sensitivity and response time were found for naming the familiar objects in unfamiliar lighting directions regardless of whether the viewpoint was familiar or unfamiliar. Together these results suggest that illumination effects such as shadow edges: (1) affect visual memory; (2) serve the function of making unambigous the three-dimensional shape; and (3) are modeled with respect to object shape, rather than simply encoded in lens of their effects in the image.

AB - A key problem in recognition is that the image of an object depends on the lighting conditions. We investigated whether recognition is sensitive to illumination using 3-D objects that were lit from either the left or right, varying both the shading and the cast shadows. In experiments 1 and 2 participants judged whether two sequentially presented objects were the same regardless of illumination. Experiment 1 used six objects that were easily discriminated and that were rendered with cast shadows. While no cost was found in sensitivity, there was a response time cost over a change in lighting direction. Experiment 2 included six additional objects that were similar to the original six objects making recognition more difficult. The objects were rendered with cast shadows, no shadows, and as a control, white shadows. With normal shadows a change in lighting direction produced costs in both sensitivity and response times. With white shadows there was a much larger cost in sensitivity and a comparable cost in response times. Without cast shadows there was no cost in either measure, but the overall performance was poorer. Experiment 3 used a naming task in which names were assigned to six objects rendered with cast shadows. Participants practised identifying the objects in two viewpoints lit from a single lighting direction. Viewpoint and illumination invariance were then tested over new viewpoints and illuminations. Costs in both sensitivity and response time were found for naming the familiar objects in unfamiliar lighting directions regardless of whether the viewpoint was familiar or unfamiliar. Together these results suggest that illumination effects such as shadow edges: (1) affect visual memory; (2) serve the function of making unambigous the three-dimensional shape; and (3) are modeled with respect to object shape, rather than simply encoded in lens of their effects in the image.

KW - 3-D objects

KW - Illumination

KW - Visual recognition system

UR - http://www.scopus.com/inward/record.url?scp=0031830392&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031830392&partnerID=8YFLogxK

U2 - 10.1016/S0042-6989(98)00041-8

DO - 10.1016/S0042-6989(98)00041-8

M3 - Article

C2 - 9797998

AN - SCOPUS:0031830392

VL - 38

SP - 2259

EP - 2275

JO - Vision Research

JF - Vision Research

SN - 0042-6989

IS - 15-16

ER -