No visual dominance for remembered turns - Psychophysical experiments on the integration of visual and vestibular cues in virtual reality

Markus von der Heyde, Bernhard E. Riecke, Douglas W. Cunningham, Heinrich Bulthoff

Research output: Contribution to journalArticle

Abstract

In most virtual reality (VR) applications turns are misperceived, which leads to disorientation. Here we focus on two cues providing no absolute spatial reference: optic flow and vestibular cues. We asked whether: (a) both visual and vestibular information are stored and can be reproduced later; and (b) if those modalities are integrated into one coherent percept or if the memory is modality specific. We used a VR setup including a motion simulator (Stewart platform) and a head-mounted display for presenting vestibular and visual stimuli, respectively. Subjects followed an invisible randomly generated path including heading changes between 8.5 and 17 degrees. Heading deviations from this path were presented as vestibular roll rotation. Hence the path was solely defined by vestibular (and proprioceptive) information. The subjects' task was to continuously adjust the roll axis of the platform to level position. They controlled their heading with a joystick and thereby maintained an upright position. After successfully following a vestibularly defined path twice, subjects were asked to reproduce it from memory. During the reproduction phase, the gain between the joystick control and the resulting visual and vestibular turns were independently varied. Subjects learned and memorized curves of the vestibularly defined virtual path and were able to reproduce the amplitudes of the turns. This demonstrates that vestibular signals can be used for spatial orientation in virtual reality. Since the modality with the bigger gain factor had a dominant effect on the reproduced turns, the integration of visual and vestibular information seems to follow a "max rule", in which the larger signal is responsible for the perceived and memorized heading change.

Original languageEnglish
JournalJournal of Vision
Volume1
Issue number3
DOIs
Publication statusPublished - 2001 Dec 1
Externally publishedYes

Fingerprint

Cues
Optic Flow
Confusion
Reproduction
Head
Spatial Orientation

ASJC Scopus subject areas

  • Ophthalmology

Cite this

No visual dominance for remembered turns - Psychophysical experiments on the integration of visual and vestibular cues in virtual reality. / von der Heyde, Markus; Riecke, Bernhard E.; Cunningham, Douglas W.; Bulthoff, Heinrich.

In: Journal of Vision, Vol. 1, No. 3, 01.12.2001.

Research output: Contribution to journalArticle

@article{5c98096c952348238a99d58241185f88,
title = "No visual dominance for remembered turns - Psychophysical experiments on the integration of visual and vestibular cues in virtual reality",
abstract = "In most virtual reality (VR) applications turns are misperceived, which leads to disorientation. Here we focus on two cues providing no absolute spatial reference: optic flow and vestibular cues. We asked whether: (a) both visual and vestibular information are stored and can be reproduced later; and (b) if those modalities are integrated into one coherent percept or if the memory is modality specific. We used a VR setup including a motion simulator (Stewart platform) and a head-mounted display for presenting vestibular and visual stimuli, respectively. Subjects followed an invisible randomly generated path including heading changes between 8.5 and 17 degrees. Heading deviations from this path were presented as vestibular roll rotation. Hence the path was solely defined by vestibular (and proprioceptive) information. The subjects' task was to continuously adjust the roll axis of the platform to level position. They controlled their heading with a joystick and thereby maintained an upright position. After successfully following a vestibularly defined path twice, subjects were asked to reproduce it from memory. During the reproduction phase, the gain between the joystick control and the resulting visual and vestibular turns were independently varied. Subjects learned and memorized curves of the vestibularly defined virtual path and were able to reproduce the amplitudes of the turns. This demonstrates that vestibular signals can be used for spatial orientation in virtual reality. Since the modality with the bigger gain factor had a dominant effect on the reproduced turns, the integration of visual and vestibular information seems to follow a {"}max rule{"}, in which the larger signal is responsible for the perceived and memorized heading change.",
author = "{von der Heyde}, Markus and Riecke, {Bernhard E.} and Cunningham, {Douglas W.} and Heinrich Bulthoff",
year = "2001",
month = "12",
day = "1",
doi = "10.1167/1.3.188",
language = "English",
volume = "1",
journal = "Journal of Vision",
issn = "1534-7362",
publisher = "Association for Research in Vision and Ophthalmology Inc.",
number = "3",

}

TY - JOUR

T1 - No visual dominance for remembered turns - Psychophysical experiments on the integration of visual and vestibular cues in virtual reality

AU - von der Heyde, Markus

AU - Riecke, Bernhard E.

AU - Cunningham, Douglas W.

AU - Bulthoff, Heinrich

PY - 2001/12/1

Y1 - 2001/12/1

N2 - In most virtual reality (VR) applications turns are misperceived, which leads to disorientation. Here we focus on two cues providing no absolute spatial reference: optic flow and vestibular cues. We asked whether: (a) both visual and vestibular information are stored and can be reproduced later; and (b) if those modalities are integrated into one coherent percept or if the memory is modality specific. We used a VR setup including a motion simulator (Stewart platform) and a head-mounted display for presenting vestibular and visual stimuli, respectively. Subjects followed an invisible randomly generated path including heading changes between 8.5 and 17 degrees. Heading deviations from this path were presented as vestibular roll rotation. Hence the path was solely defined by vestibular (and proprioceptive) information. The subjects' task was to continuously adjust the roll axis of the platform to level position. They controlled their heading with a joystick and thereby maintained an upright position. After successfully following a vestibularly defined path twice, subjects were asked to reproduce it from memory. During the reproduction phase, the gain between the joystick control and the resulting visual and vestibular turns were independently varied. Subjects learned and memorized curves of the vestibularly defined virtual path and were able to reproduce the amplitudes of the turns. This demonstrates that vestibular signals can be used for spatial orientation in virtual reality. Since the modality with the bigger gain factor had a dominant effect on the reproduced turns, the integration of visual and vestibular information seems to follow a "max rule", in which the larger signal is responsible for the perceived and memorized heading change.

AB - In most virtual reality (VR) applications turns are misperceived, which leads to disorientation. Here we focus on two cues providing no absolute spatial reference: optic flow and vestibular cues. We asked whether: (a) both visual and vestibular information are stored and can be reproduced later; and (b) if those modalities are integrated into one coherent percept or if the memory is modality specific. We used a VR setup including a motion simulator (Stewart platform) and a head-mounted display for presenting vestibular and visual stimuli, respectively. Subjects followed an invisible randomly generated path including heading changes between 8.5 and 17 degrees. Heading deviations from this path were presented as vestibular roll rotation. Hence the path was solely defined by vestibular (and proprioceptive) information. The subjects' task was to continuously adjust the roll axis of the platform to level position. They controlled their heading with a joystick and thereby maintained an upright position. After successfully following a vestibularly defined path twice, subjects were asked to reproduce it from memory. During the reproduction phase, the gain between the joystick control and the resulting visual and vestibular turns were independently varied. Subjects learned and memorized curves of the vestibularly defined virtual path and were able to reproduce the amplitudes of the turns. This demonstrates that vestibular signals can be used for spatial orientation in virtual reality. Since the modality with the bigger gain factor had a dominant effect on the reproduced turns, the integration of visual and vestibular information seems to follow a "max rule", in which the larger signal is responsible for the perceived and memorized heading change.

UR - http://www.scopus.com/inward/record.url?scp=4143130090&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=4143130090&partnerID=8YFLogxK

U2 - 10.1167/1.3.188

DO - 10.1167/1.3.188

M3 - Article

AN - SCOPUS:4143130090

VL - 1

JO - Journal of Vision

JF - Journal of Vision

SN - 1534-7362

IS - 3

ER -