Abstract
Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.
| Original language | English |
|---|---|
| Title of host publication | Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings |
| Editors | Gino Fragomeni, Jessie Y.C. Chen |
| Publisher | Springer Verlag |
| Pages | 143-152 |
| Number of pages | 10 |
| ISBN (Print) | 9783030216061 |
| DOIs | |
| Publication status | Published - 2019 Jan 1 |
| Event | 11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States Duration: 2019 Jul 26 → 2019 Jul 31 |
Publication series
| Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
|---|---|
| Volume | 11574 LNCS |
| ISSN (Print) | 0302-9743 |
| ISSN (Electronic) | 1611-3349 |
Conference
| Conference | 11th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 |
|---|---|
| Country | United States |
| City | Orlando |
| Period | 19/7/26 → 19/7/31 |
Fingerprint
Keywords
- Onomatopoeia
- Sound visualization
- User experience
- Virtual reality
ASJC Scopus subject areas
- Theoretical Computer Science
- Computer Science(all)
Cite this
The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality. / Oh, Jiwon; Kim, Jeonghyun.
Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings. ed. / Gino Fragomeni; Jessie Y.C. Chen. Springer Verlag, 2019. p. 143-152 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11574 LNCS).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - The Effect of Onomatopoeia to Enhancing User Experience in Virtual Reality
AU - Oh, Jiwon
AU - Kim, Jeonghyun
PY - 2019/1/1
Y1 - 2019/1/1
N2 - Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.
AB - Onomatopoeia refers to a word that phonetically imitates, resembles, or suggests the sound (or motion that accompanies sound) that it describes. It is often used in comics, games, and videos, along with the actual sound in caption. This usage is a way to emphasize, exaggerate, dramatize and draw attention the situation. In this paper we explore if the use of onomatopoeia, associated with sound feedback, could also bring about similar effects and improve the user experience in immersive virtual reality. We present an experiment comparing the user’s subjective experiences and attentive performance in two virtual worlds, each configured in two test conditions: (1) sound feedback with no onomatopoeia and (2) sound feedback with it. Our experiment has found that the moderate and strategic use of onomatopoeia can indeed help direct user attention, offer object affordance and thereby enhance user experience and even the sense of presence and immersion.
KW - Onomatopoeia
KW - Sound visualization
KW - User experience
KW - Virtual reality
UR - http://www.scopus.com/inward/record.url?scp=85069642902&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85069642902&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-21607-8_11
DO - 10.1007/978-3-030-21607-8_11
M3 - Conference contribution
AN - SCOPUS:85069642902
SN - 9783030216061
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 143
EP - 152
BT - Virtual, Augmented and Mixed Reality. Multimodal Interaction - 11th International Conference, VAMR 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
A2 - Fragomeni, Gino
A2 - Chen, Jessie Y.C.
PB - Springer Verlag
ER -