Augmented reality-based remote coaching for fast-paced physical task

Youngsun Kim, Seokjun Hong, Jeonghyun Kim

Research output: Contribution to journalArticle

Abstract

One popular application of augmented reality (AR) is the real-time guidance and training in which the AR user receives useful information by a remote expert. For relatively fast-paced tasks, presentation of such guidance in a way that the recipient can make immediate recognition and quick understanding can be an especially challenging problem. In this paper, we present an AR-based tele-coaching system applied to the game of tennis, called the AR coach, and explore for interface design guidelines through a user study. We have evaluated the player’s performance for instruction understanding when the coaching instruction was presented in four different modalities: (1) Visual—visual only, (2) Sound—aural only/mono, (3) 3D Sound—aural only/3D and (4) Multimodal—both visual and aural/mono. Results from the experiment suggested that, among the three, the visual-only augmentation was the most effective and least distracting for the given pace of information transfer (e.g., under every 3 s). We attribute such a result to the characteristic of the visual modality to encode and present a lot of information at once and the human’s limited capability in handling and fusing multimodal information at a relatively fast rate.

Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalVirtual Reality
DOIs
Publication statusAccepted/In press - 2017 May 10

Fingerprint

Augmented reality
Experiments

Keywords

  • Augmented reality
  • Multimodal feedback
  • Pre-attentive recognition
  • Tele-coaching

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this

Augmented reality-based remote coaching for fast-paced physical task. / Kim, Youngsun; Hong, Seokjun; Kim, Jeonghyun.

In: Virtual Reality, 10.05.2017, p. 1-12.

Research output: Contribution to journalArticle

@article{f64ae3d211a742e695a81b79a976bafc,
title = "Augmented reality-based remote coaching for fast-paced physical task",
abstract = "One popular application of augmented reality (AR) is the real-time guidance and training in which the AR user receives useful information by a remote expert. For relatively fast-paced tasks, presentation of such guidance in a way that the recipient can make immediate recognition and quick understanding can be an especially challenging problem. In this paper, we present an AR-based tele-coaching system applied to the game of tennis, called the AR coach, and explore for interface design guidelines through a user study. We have evaluated the player’s performance for instruction understanding when the coaching instruction was presented in four different modalities: (1) Visual—visual only, (2) Sound—aural only/mono, (3) 3D Sound—aural only/3D and (4) Multimodal—both visual and aural/mono. Results from the experiment suggested that, among the three, the visual-only augmentation was the most effective and least distracting for the given pace of information transfer (e.g., under every 3 s). We attribute such a result to the characteristic of the visual modality to encode and present a lot of information at once and the human’s limited capability in handling and fusing multimodal information at a relatively fast rate.",
keywords = "Augmented reality, Multimodal feedback, Pre-attentive recognition, Tele-coaching",
author = "Youngsun Kim and Seokjun Hong and Jeonghyun Kim",
year = "2017",
month = "5",
day = "10",
doi = "10.1007/s10055-017-0315-2",
language = "English",
pages = "1--12",
journal = "Virtual Reality",
issn = "1359-4338",
publisher = "Springer London",

}

TY - JOUR

T1 - Augmented reality-based remote coaching for fast-paced physical task

AU - Kim, Youngsun

AU - Hong, Seokjun

AU - Kim, Jeonghyun

PY - 2017/5/10

Y1 - 2017/5/10

N2 - One popular application of augmented reality (AR) is the real-time guidance and training in which the AR user receives useful information by a remote expert. For relatively fast-paced tasks, presentation of such guidance in a way that the recipient can make immediate recognition and quick understanding can be an especially challenging problem. In this paper, we present an AR-based tele-coaching system applied to the game of tennis, called the AR coach, and explore for interface design guidelines through a user study. We have evaluated the player’s performance for instruction understanding when the coaching instruction was presented in four different modalities: (1) Visual—visual only, (2) Sound—aural only/mono, (3) 3D Sound—aural only/3D and (4) Multimodal—both visual and aural/mono. Results from the experiment suggested that, among the three, the visual-only augmentation was the most effective and least distracting for the given pace of information transfer (e.g., under every 3 s). We attribute such a result to the characteristic of the visual modality to encode and present a lot of information at once and the human’s limited capability in handling and fusing multimodal information at a relatively fast rate.

AB - One popular application of augmented reality (AR) is the real-time guidance and training in which the AR user receives useful information by a remote expert. For relatively fast-paced tasks, presentation of such guidance in a way that the recipient can make immediate recognition and quick understanding can be an especially challenging problem. In this paper, we present an AR-based tele-coaching system applied to the game of tennis, called the AR coach, and explore for interface design guidelines through a user study. We have evaluated the player’s performance for instruction understanding when the coaching instruction was presented in four different modalities: (1) Visual—visual only, (2) Sound—aural only/mono, (3) 3D Sound—aural only/3D and (4) Multimodal—both visual and aural/mono. Results from the experiment suggested that, among the three, the visual-only augmentation was the most effective and least distracting for the given pace of information transfer (e.g., under every 3 s). We attribute such a result to the characteristic of the visual modality to encode and present a lot of information at once and the human’s limited capability in handling and fusing multimodal information at a relatively fast rate.

KW - Augmented reality

KW - Multimodal feedback

KW - Pre-attentive recognition

KW - Tele-coaching

UR - http://www.scopus.com/inward/record.url?scp=85019101055&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019101055&partnerID=8YFLogxK

U2 - 10.1007/s10055-017-0315-2

DO - 10.1007/s10055-017-0315-2

M3 - Article

AN - SCOPUS:85019101055

SP - 1

EP - 12

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

ER -