A comparison of visual and haptic object representations based on similarity

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Do we judge similarity between two objects to be the same using touch and vision? We investigated this using psychophysical experiments in which subjects rated the similarity between objects presented either visually or haptically. The stimuli were a family of novel, three-dimensional objects whose microgeometry ("texture") and macrogeometry ("shape") were parametrically varied, Multidimensional scaling of the similarity data was used to reconstruct haptic and visual perceptual spaces. For both modalities, a two-dimensional perceptual space was found whose dimensions clearly corresponded to shape and texture. Interestingly, shape dominated in visual space, whereas both shape and texture were important in haptic space. Furthermore, stimuli clusters were observed in this space, suggesting the emergence of category structure based on similarity relationships. The same category boundaries were confirmed in a visual free sorting experiment. This study reveals differences in object processing across modality and demonstrates an approach for analyzing such differences in multisensory visualizations.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Information Visualisation
Pages33-40
Number of pages8
Volume2005
DOIs
Publication statusPublished - 2005 Dec 1
Externally publishedYes
Event9th International Conference on Information Visualisation, iV05 - London, United Kingdom
Duration: 2005 Jul 62005 Jul 8

Other

Other9th International Conference on Information Visualisation, iV05
CountryUnited Kingdom
CityLondon
Period05/7/605/7/8

Fingerprint

Textures
Sorting
Visualization
Experiments
Processing

Keywords

  • Categorization
  • MDS
  • Psychophysics
  • Shape
  • Similarity
  • Texture
  • Touch/haptic
  • Vision

ASJC Scopus subject areas

  • Computer Science(all)
  • Engineering(all)

Cite this

Cooke, T., Wallraven, C., & Bulthoff, H. (2005). A comparison of visual and haptic object representations based on similarity. In Proceedings of the International Conference on Information Visualisation (Vol. 2005, pp. 33-40). [1509056] https://doi.org/10.1109/IV.2005.6

A comparison of visual and haptic object representations based on similarity. / Cooke, Theresa; Wallraven, Christian; Bulthoff, Heinrich.

Proceedings of the International Conference on Information Visualisation. Vol. 2005 2005. p. 33-40 1509056.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cooke, T, Wallraven, C & Bulthoff, H 2005, A comparison of visual and haptic object representations based on similarity. in Proceedings of the International Conference on Information Visualisation. vol. 2005, 1509056, pp. 33-40, 9th International Conference on Information Visualisation, iV05, London, United Kingdom, 05/7/6. https://doi.org/10.1109/IV.2005.6
Cooke T, Wallraven C, Bulthoff H. A comparison of visual and haptic object representations based on similarity. In Proceedings of the International Conference on Information Visualisation. Vol. 2005. 2005. p. 33-40. 1509056 https://doi.org/10.1109/IV.2005.6
Cooke, Theresa ; Wallraven, Christian ; Bulthoff, Heinrich. / A comparison of visual and haptic object representations based on similarity. Proceedings of the International Conference on Information Visualisation. Vol. 2005 2005. pp. 33-40
@inproceedings{aa98bdd362ae46f0b97de5aa93e440fd,
title = "A comparison of visual and haptic object representations based on similarity",
abstract = "Do we judge similarity between two objects to be the same using touch and vision? We investigated this using psychophysical experiments in which subjects rated the similarity between objects presented either visually or haptically. The stimuli were a family of novel, three-dimensional objects whose microgeometry ({"}texture{"}) and macrogeometry ({"}shape{"}) were parametrically varied, Multidimensional scaling of the similarity data was used to reconstruct haptic and visual perceptual spaces. For both modalities, a two-dimensional perceptual space was found whose dimensions clearly corresponded to shape and texture. Interestingly, shape dominated in visual space, whereas both shape and texture were important in haptic space. Furthermore, stimuli clusters were observed in this space, suggesting the emergence of category structure based on similarity relationships. The same category boundaries were confirmed in a visual free sorting experiment. This study reveals differences in object processing across modality and demonstrates an approach for analyzing such differences in multisensory visualizations.",
keywords = "Categorization, MDS, Psychophysics, Shape, Similarity, Texture, Touch/haptic, Vision",
author = "Theresa Cooke and Christian Wallraven and Heinrich Bulthoff",
year = "2005",
month = "12",
day = "1",
doi = "10.1109/IV.2005.6",
language = "English",
isbn = "0769523978",
volume = "2005",
pages = "33--40",
booktitle = "Proceedings of the International Conference on Information Visualisation",

}

TY - GEN

T1 - A comparison of visual and haptic object representations based on similarity

AU - Cooke, Theresa

AU - Wallraven, Christian

AU - Bulthoff, Heinrich

PY - 2005/12/1

Y1 - 2005/12/1

N2 - Do we judge similarity between two objects to be the same using touch and vision? We investigated this using psychophysical experiments in which subjects rated the similarity between objects presented either visually or haptically. The stimuli were a family of novel, three-dimensional objects whose microgeometry ("texture") and macrogeometry ("shape") were parametrically varied, Multidimensional scaling of the similarity data was used to reconstruct haptic and visual perceptual spaces. For both modalities, a two-dimensional perceptual space was found whose dimensions clearly corresponded to shape and texture. Interestingly, shape dominated in visual space, whereas both shape and texture were important in haptic space. Furthermore, stimuli clusters were observed in this space, suggesting the emergence of category structure based on similarity relationships. The same category boundaries were confirmed in a visual free sorting experiment. This study reveals differences in object processing across modality and demonstrates an approach for analyzing such differences in multisensory visualizations.

AB - Do we judge similarity between two objects to be the same using touch and vision? We investigated this using psychophysical experiments in which subjects rated the similarity between objects presented either visually or haptically. The stimuli were a family of novel, three-dimensional objects whose microgeometry ("texture") and macrogeometry ("shape") were parametrically varied, Multidimensional scaling of the similarity data was used to reconstruct haptic and visual perceptual spaces. For both modalities, a two-dimensional perceptual space was found whose dimensions clearly corresponded to shape and texture. Interestingly, shape dominated in visual space, whereas both shape and texture were important in haptic space. Furthermore, stimuli clusters were observed in this space, suggesting the emergence of category structure based on similarity relationships. The same category boundaries were confirmed in a visual free sorting experiment. This study reveals differences in object processing across modality and demonstrates an approach for analyzing such differences in multisensory visualizations.

KW - Categorization

KW - MDS

KW - Psychophysics

KW - Shape

KW - Similarity

KW - Texture

KW - Touch/haptic

KW - Vision

UR - http://www.scopus.com/inward/record.url?scp=33749048062&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33749048062&partnerID=8YFLogxK

U2 - 10.1109/IV.2005.6

DO - 10.1109/IV.2005.6

M3 - Conference contribution

AN - SCOPUS:33749048062

SN - 0769523978

SN - 9780769523972

VL - 2005

SP - 33

EP - 40

BT - Proceedings of the International Conference on Information Visualisation

ER -