Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality

Hyeonah Choi, Jiwon Oh, Minwook Chang, Jeonghyun Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Onomatopoeia refers to a word that phonetically imitates, resembles the sound, or depict an event at hand. In languages like Korean and Japanese, it is used in everyday conversation to emphasize certain situation and enrich the prose. In this poster, we explore if the use of onomatopoeia, visualized and added to the usual sound feedback, could be taken advantage to increase or alter the perceived realism of the sound feedback itself, and furthermore of the situation at hand in virtual reality. A pilot experiment was run to compare the user’s subjective perceived realism and experience under four test conditions of presenting a simple physical interaction, accompanying it with: (1) just the “as-is” sound (baseline), (2) “as-is” sound and onomatopoeia, (3) a representative sound sample (e.g. one for all different collision conditions), and (4) a representative sound sample and onomatopoeia. Our pilot study has found that the use of onomatopoeia can alter and add on to the perceived realism/naturalness of the virtual situation such that the experiences of the single representative sound added with the onomatopoeia and “as-is” sound were deemed similar.

Original languageEnglish
Title of host publicationProceedings - VRST 2018
Subtitle of host publication24th ACM Symposium on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450360869
DOIs
Publication statusPublished - 2018 Nov 28
Event24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
Duration: 2018 Nov 282018 Dec 1

Other

Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
CountryJapan
CityTokyo
Period18/11/2818/12/1

Fingerprint

Virtual reality
Acoustic waves
Feedback

Keywords

  • Onomatopoeia
  • Realism.
  • Sound feedback
  • Virtual reality

ASJC Scopus subject areas

  • Software

Cite this

Choi, H., Oh, J., Chang, M., & Kim, J. (2018). Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. In S. N. Spencer (Ed.), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology [3281614] Association for Computing Machinery. https://doi.org/10.1145/3281505.3281614

Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. / Choi, Hyeonah; Oh, Jiwon; Chang, Minwook; Kim, Jeonghyun.

Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. ed. / Stephen N. Spencer. Association for Computing Machinery, 2018. 3281614.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Choi, H, Oh, J, Chang, M & Kim, J 2018, Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. in SN Spencer (ed.), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology., 3281614, Association for Computing Machinery, 24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018, Tokyo, Japan, 18/11/28. https://doi.org/10.1145/3281505.3281614
Choi H, Oh J, Chang M, Kim J. Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. In Spencer SN, editor, Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery. 2018. 3281614 https://doi.org/10.1145/3281505.3281614
Choi, Hyeonah ; Oh, Jiwon ; Chang, Minwook ; Kim, Jeonghyun. / Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality. Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology. editor / Stephen N. Spencer. Association for Computing Machinery, 2018.
@inproceedings{9ad3660781134a21be57e7b594ee6295,
title = "Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality",
abstract = "Onomatopoeia refers to a word that phonetically imitates, resembles the sound, or depict an event at hand. In languages like Korean and Japanese, it is used in everyday conversation to emphasize certain situation and enrich the prose. In this poster, we explore if the use of onomatopoeia, visualized and added to the usual sound feedback, could be taken advantage to increase or alter the perceived realism of the sound feedback itself, and furthermore of the situation at hand in virtual reality. A pilot experiment was run to compare the user’s subjective perceived realism and experience under four test conditions of presenting a simple physical interaction, accompanying it with: (1) just the “as-is” sound (baseline), (2) “as-is” sound and onomatopoeia, (3) a representative sound sample (e.g. one for all different collision conditions), and (4) a representative sound sample and onomatopoeia. Our pilot study has found that the use of onomatopoeia can alter and add on to the perceived realism/naturalness of the virtual situation such that the experiences of the single representative sound added with the onomatopoeia and “as-is” sound were deemed similar.",
keywords = "Onomatopoeia, Realism., Sound feedback, Virtual reality",
author = "Hyeonah Choi and Jiwon Oh and Minwook Chang and Jeonghyun Kim",
year = "2018",
month = "11",
day = "28",
doi = "10.1145/3281505.3281614",
language = "English",
editor = "Spencer, {Stephen N.}",
booktitle = "Proceedings - VRST 2018",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Effect of accompanying onomatopoeia to interaction sound for altering user perception in virtual reality

AU - Choi, Hyeonah

AU - Oh, Jiwon

AU - Chang, Minwook

AU - Kim, Jeonghyun

PY - 2018/11/28

Y1 - 2018/11/28

N2 - Onomatopoeia refers to a word that phonetically imitates, resembles the sound, or depict an event at hand. In languages like Korean and Japanese, it is used in everyday conversation to emphasize certain situation and enrich the prose. In this poster, we explore if the use of onomatopoeia, visualized and added to the usual sound feedback, could be taken advantage to increase or alter the perceived realism of the sound feedback itself, and furthermore of the situation at hand in virtual reality. A pilot experiment was run to compare the user’s subjective perceived realism and experience under four test conditions of presenting a simple physical interaction, accompanying it with: (1) just the “as-is” sound (baseline), (2) “as-is” sound and onomatopoeia, (3) a representative sound sample (e.g. one for all different collision conditions), and (4) a representative sound sample and onomatopoeia. Our pilot study has found that the use of onomatopoeia can alter and add on to the perceived realism/naturalness of the virtual situation such that the experiences of the single representative sound added with the onomatopoeia and “as-is” sound were deemed similar.

AB - Onomatopoeia refers to a word that phonetically imitates, resembles the sound, or depict an event at hand. In languages like Korean and Japanese, it is used in everyday conversation to emphasize certain situation and enrich the prose. In this poster, we explore if the use of onomatopoeia, visualized and added to the usual sound feedback, could be taken advantage to increase or alter the perceived realism of the sound feedback itself, and furthermore of the situation at hand in virtual reality. A pilot experiment was run to compare the user’s subjective perceived realism and experience under four test conditions of presenting a simple physical interaction, accompanying it with: (1) just the “as-is” sound (baseline), (2) “as-is” sound and onomatopoeia, (3) a representative sound sample (e.g. one for all different collision conditions), and (4) a representative sound sample and onomatopoeia. Our pilot study has found that the use of onomatopoeia can alter and add on to the perceived realism/naturalness of the virtual situation such that the experiences of the single representative sound added with the onomatopoeia and “as-is” sound were deemed similar.

KW - Onomatopoeia

KW - Realism.

KW - Sound feedback

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85060909109&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060909109&partnerID=8YFLogxK

U2 - 10.1145/3281505.3281614

DO - 10.1145/3281505.3281614

M3 - Conference contribution

AN - SCOPUS:85060909109

BT - Proceedings - VRST 2018

A2 - Spencer, Stephen N.

PB - Association for Computing Machinery

ER -