Perceptual representations of parametrically-defined and natural objects comparing vision and haptics

Nina Gaißert, Christian Wallraven

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Studies concerning how the brain might represent objects by means of a perceptual space have primarily focused on the visual domain. Here we want to show that the haptic modality can equally well recover the underlying structure of a physical object space, forming a perceptual space that is highly congruent to the visual perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Sighted participants explored pictures of the objects while blindfolded participants haptically explored 3D printouts of the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. Visual and haptic similarity ratings highly correlated and resulted in very similar visual and haptic MDS maps. To investigate to which degree these results are transferrable to natural objects, we performed the same visual and haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found very similar perceptual spaces in the haptic and visual domain. Our results suggest that the haptic modality is capable of surprisingly acute processing of complex shape.

Original languageEnglish
Title of host publication2010 IEEE Haptics Symposium, HAPTICS 2010
Pages35-42
Number of pages8
DOIs
Publication statusPublished - 2010 May 31
Externally publishedYes
Event2010 IEEE Haptics Symposium, HAPTICS 2010 - Waltham, MA, United States
Duration: 2010 Mar 252010 Mar 26

Other

Other2010 IEEE Haptics Symposium, HAPTICS 2010
CountryUnited States
CityWaltham, MA
Period10/3/2510/3/26

Fingerprint

Brain
Processing

Keywords

  • Computer generated objects
  • Haptics
  • I.4.10 [image processing and computer vision]: image representation-multidimensional
  • I.4.7 [image processing and computer vision]: feature measurement feature representation
  • I.5.3 [pattern recognition]: clustering-similarity measures
  • Multidimensional scaling
  • Natural objects
  • Perceptual space
  • Vision

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Perceptual representations of parametrically-defined and natural objects comparing vision and haptics. / Gaißert, Nina; Wallraven, Christian.

2010 IEEE Haptics Symposium, HAPTICS 2010. 2010. p. 35-42 5444683.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gaißert, N & Wallraven, C 2010, Perceptual representations of parametrically-defined and natural objects comparing vision and haptics. in 2010 IEEE Haptics Symposium, HAPTICS 2010., 5444683, pp. 35-42, 2010 IEEE Haptics Symposium, HAPTICS 2010, Waltham, MA, United States, 10/3/25. https://doi.org/10.1109/HAPTIC.2010.5444683
@inproceedings{fb55d1a80d2d49ff9c2ecb618a0c6876,
title = "Perceptual representations of parametrically-defined and natural objects comparing vision and haptics",
abstract = "Studies concerning how the brain might represent objects by means of a perceptual space have primarily focused on the visual domain. Here we want to show that the haptic modality can equally well recover the underlying structure of a physical object space, forming a perceptual space that is highly congruent to the visual perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Sighted participants explored pictures of the objects while blindfolded participants haptically explored 3D printouts of the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. Visual and haptic similarity ratings highly correlated and resulted in very similar visual and haptic MDS maps. To investigate to which degree these results are transferrable to natural objects, we performed the same visual and haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found very similar perceptual spaces in the haptic and visual domain. Our results suggest that the haptic modality is capable of surprisingly acute processing of complex shape.",
keywords = "Computer generated objects, Haptics, I.4.10 [image processing and computer vision]: image representation-multidimensional, I.4.7 [image processing and computer vision]: feature measurement feature representation, I.5.3 [pattern recognition]: clustering-similarity measures, Multidimensional scaling, Natural objects, Perceptual space, Vision",
author = "Nina Gai{\ss}ert and Christian Wallraven",
year = "2010",
month = "5",
day = "31",
doi = "10.1109/HAPTIC.2010.5444683",
language = "English",
isbn = "9781424468218",
pages = "35--42",
booktitle = "2010 IEEE Haptics Symposium, HAPTICS 2010",

}

TY - GEN

T1 - Perceptual representations of parametrically-defined and natural objects comparing vision and haptics

AU - Gaißert, Nina

AU - Wallraven, Christian

PY - 2010/5/31

Y1 - 2010/5/31

N2 - Studies concerning how the brain might represent objects by means of a perceptual space have primarily focused on the visual domain. Here we want to show that the haptic modality can equally well recover the underlying structure of a physical object space, forming a perceptual space that is highly congruent to the visual perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Sighted participants explored pictures of the objects while blindfolded participants haptically explored 3D printouts of the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. Visual and haptic similarity ratings highly correlated and resulted in very similar visual and haptic MDS maps. To investigate to which degree these results are transferrable to natural objects, we performed the same visual and haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found very similar perceptual spaces in the haptic and visual domain. Our results suggest that the haptic modality is capable of surprisingly acute processing of complex shape.

AB - Studies concerning how the brain might represent objects by means of a perceptual space have primarily focused on the visual domain. Here we want to show that the haptic modality can equally well recover the underlying structure of a physical object space, forming a perceptual space that is highly congruent to the visual perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Sighted participants explored pictures of the objects while blindfolded participants haptically explored 3D printouts of the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. Visual and haptic similarity ratings highly correlated and resulted in very similar visual and haptic MDS maps. To investigate to which degree these results are transferrable to natural objects, we performed the same visual and haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found very similar perceptual spaces in the haptic and visual domain. Our results suggest that the haptic modality is capable of surprisingly acute processing of complex shape.

KW - Computer generated objects

KW - Haptics

KW - I.4.10 [image processing and computer vision]: image representation-multidimensional

KW - I.4.7 [image processing and computer vision]: feature measurement feature representation

KW - I.5.3 [pattern recognition]: clustering-similarity measures

KW - Multidimensional scaling

KW - Natural objects

KW - Perceptual space

KW - Vision

UR - http://www.scopus.com/inward/record.url?scp=77952699220&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952699220&partnerID=8YFLogxK

U2 - 10.1109/HAPTIC.2010.5444683

DO - 10.1109/HAPTIC.2010.5444683

M3 - Conference contribution

AN - SCOPUS:77952699220

SN - 9781424468218

SP - 35

EP - 42

BT - 2010 IEEE Haptics Symposium, HAPTICS 2010

ER -