Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality

Hyeonah Choi, Jiwon Oh, Minwook Chang, Jeonghyun Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Onomatopoeia refers to a word that phonetically imitates, resembles the sound, or depict an event at hand. In languages like Korean and Japanese, it is used in everyday conversation to emphasize certain situation and enrich the prose. In this poster, we explore if the use of onomatopoeia, visualized and added to the usual sound feedback, could be taken advantage to increase or alter the perceived realism of the sound feedback itself, and furthermore of the situation at hand in virtual reality. A pilot experiment was run to compare the user’s subjective perceived realism and experience under four test conditions of presenting a simple physical interaction, accompanying it with: (1) just the “as-is” sound (baseline), (2) “as-is” sound and onomatopoeia, (3) a representative sound sample (e.g. one for all different collision conditions), and (4) a representative sound sample and onomatopoeia. Our pilot study has found that the use of onomatopoeia can alter and add on to the perceived realism/naturalness of the virtual situation such that the experiences of the single representative sound added with the onomatopoeia and “as-is” sound were deemed similar.

Original languageEnglish
Title of host publicationProceedings - VRST 2018
Subtitle of host publication24th ACM Symposium on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450360869
DOIs
Publication statusPublished - 2018 Nov 28
Event24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
Duration: 2018 Nov 282018 Dec 1

Other

Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
CountryJapan
CityTokyo
Period18/11/2818/12/1

    Fingerprint

Keywords

  • Onomatopoeia
  • Realism.
  • Sound feedback
  • Virtual reality

ASJC Scopus subject areas

  • Software

Cite this

Choi, H., Oh, J., Chang, M., & Kim, J. (2018). Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. In S. N. Spencer (Ed.), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology [3281614] Association for Computing Machinery. https://doi.org/10.1145/3281505.3281614