Integrating visual and haptic shape information to form a multimodal perceptual space

Nina Gaißert, Christian Wallraven

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.

Original languageEnglish
Title of host publication2011 IEEE World Haptics Conference, WHC 2011
Pages451-456
Number of pages6
DOIs
Publication statusPublished - 2011 Aug 11
Event2011 IEEE World Haptics Conference, WHC 2011 - Istanbul, Turkey
Duration: 2011 Jun 222011 Jun 24

Other

Other2011 IEEE World Haptics Conference, WHC 2011
CountryTurkey
CityIstanbul
Period11/6/2211/6/24

Keywords

  • computer generated objects
  • multidimensional scaling
  • Multimodal perceptual space
  • natural objects

ASJC Scopus subject areas

  • Human-Computer Interaction

Cite this

Gaißert, N., & Wallraven, C. (2011). Integrating visual and haptic shape information to form a multimodal perceptual space. In 2011 IEEE World Haptics Conference, WHC 2011 (pp. 451-456). [5945528] https://doi.org/10.1109/WHC.2011.5945528

Integrating visual and haptic shape information to form a multimodal perceptual space. / Gaißert, Nina; Wallraven, Christian.

2011 IEEE World Haptics Conference, WHC 2011. 2011. p. 451-456 5945528.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gaißert, N & Wallraven, C 2011, Integrating visual and haptic shape information to form a multimodal perceptual space. in 2011 IEEE World Haptics Conference, WHC 2011., 5945528, pp. 451-456, 2011 IEEE World Haptics Conference, WHC 2011, Istanbul, Turkey, 11/6/22. https://doi.org/10.1109/WHC.2011.5945528
Gaißert, Nina ; Wallraven, Christian. / Integrating visual and haptic shape information to form a multimodal perceptual space. 2011 IEEE World Haptics Conference, WHC 2011. 2011. pp. 451-456
@inproceedings{98f379a68b0f4f0fb31237dabb773e8d,
title = "Integrating visual and haptic shape information to form a multimodal perceptual space",
abstract = "In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.",
keywords = "computer generated objects, multidimensional scaling, Multimodal perceptual space, natural objects",
author = "Nina Gai{\ss}ert and Christian Wallraven",
year = "2011",
month = "8",
day = "11",
doi = "10.1109/WHC.2011.5945528",
language = "English",
isbn = "9781457702976",
pages = "451--456",
booktitle = "2011 IEEE World Haptics Conference, WHC 2011",

}

TY - GEN

T1 - Integrating visual and haptic shape information to form a multimodal perceptual space

AU - Gaißert, Nina

AU - Wallraven, Christian

PY - 2011/8/11

Y1 - 2011/8/11

N2 - In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.

AB - In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.

KW - computer generated objects

KW - multidimensional scaling

KW - Multimodal perceptual space

KW - natural objects

UR - http://www.scopus.com/inward/record.url?scp=79961188877&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79961188877&partnerID=8YFLogxK

U2 - 10.1109/WHC.2011.5945528

DO - 10.1109/WHC.2011.5945528

M3 - Conference contribution

AN - SCOPUS:79961188877

SN - 9781457702976

SP - 451

EP - 456

BT - 2011 IEEE World Haptics Conference, WHC 2011

ER -