Bayesian integration of visual and vestibular signals for heading

John S. Butler, Stuart T. Smith, Jennifer L. Campos, Heinrich Bulthoff

Research output: Contribution to journalArticle

127 Citations (Scopus)

Abstract

Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual-vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual-vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.

Original languageEnglish
Pages (from-to)1-13
Number of pages13
JournalJournal of Vision
Volume10
Issue number11
DOIs
Publication statusPublished - 2010 Nov 23

Fingerprint

Cues
Weights and Measures
Conflict (Psychology)

Keywords

  • Bayesian
  • Heading
  • Human
  • Spatial conflict
  • Vestibular
  • Visual

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems

Cite this

Bayesian integration of visual and vestibular signals for heading. / Butler, John S.; Smith, Stuart T.; Campos, Jennifer L.; Bulthoff, Heinrich.

In: Journal of Vision, Vol. 10, No. 11, 23.11.2010, p. 1-13.

Research output: Contribution to journalArticle

Butler, John S. ; Smith, Stuart T. ; Campos, Jennifer L. ; Bulthoff, Heinrich. / Bayesian integration of visual and vestibular signals for heading. In: Journal of Vision. 2010 ; Vol. 10, No. 11. pp. 1-13.
@article{1cd6b303d91549e6a405480baab6d32b,
title = "Bayesian integration of visual and vestibular signals for heading",
abstract = "Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual-vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual-vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.",
keywords = "Bayesian, Heading, Human, Spatial conflict, Vestibular, Visual",
author = "Butler, {John S.} and Smith, {Stuart T.} and Campos, {Jennifer L.} and Heinrich Bulthoff",
year = "2010",
month = "11",
day = "23",
doi = "10.1167/10.11.23",
language = "English",
volume = "10",
pages = "1--13",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "11",

}

TY - JOUR

T1 - Bayesian integration of visual and vestibular signals for heading

AU - Butler, John S.

AU - Smith, Stuart T.

AU - Campos, Jennifer L.

AU - Bulthoff, Heinrich

PY - 2010/11/23

Y1 - 2010/11/23

N2 - Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual-vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual-vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.

AB - Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual-vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual-vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.

KW - Bayesian

KW - Heading

KW - Human

KW - Spatial conflict

KW - Vestibular

KW - Visual

UR - http://www.scopus.com/inward/record.url?scp=78449251520&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78449251520&partnerID=8YFLogxK

U2 - 10.1167/10.11.23

DO - 10.1167/10.11.23

M3 - Article

C2 - 20884518

AN - SCOPUS:78449251520

VL - 10

SP - 1

EP - 13

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 11

ER -