Empathetic video clip experience through timely multimodal interaction

Myunghee Lee, Jeonghyun Kim

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

In this article, we describe a video clip playing system, named “Empatheater,” that is controlled by multimodal interaction. As the video clip is played, the user can interact and emulate predefined video “events” through guidance and multimodal natural interaction (e.g. following the main character’s motion, gestures or voice). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of Empatheater is to provide indirect experience of the given video content by eliciting the user to mimic and empathize with the main character. The user is given the illusion (or suspended disbelief) of playing an active role in the unraveling video content. We first discuss the overall system architecture, and important components and features of Empatheater. In addition, we report on the results of the experiments that were carried out to evaluate perceived empathy, presence/immersion and subjective user experience with it as compared to conventional passive video viewing for different content genres and forms of interaction.

Original languageEnglish
Pages (from-to)273-288
Number of pages16
JournalJournal on Multimodal User Interfaces
Volume8
Issue number3
DOIs
Publication statusPublished - 2014 Jan 1

Fingerprint

Experiments

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Signal Processing

Cite this

Empathetic video clip experience through timely multimodal interaction. / Lee, Myunghee; Kim, Jeonghyun.

In: Journal on Multimodal User Interfaces, Vol. 8, No. 3, 01.01.2014, p. 273-288.

Research output: Contribution to journalArticle

@article{e98cecc41562427dbaf2800c3be5d86c,
title = "Empathetic video clip experience through timely multimodal interaction",
abstract = "In this article, we describe a video clip playing system, named “Empatheater,” that is controlled by multimodal interaction. As the video clip is played, the user can interact and emulate predefined video “events” through guidance and multimodal natural interaction (e.g. following the main character’s motion, gestures or voice). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of Empatheater is to provide indirect experience of the given video content by eliciting the user to mimic and empathize with the main character. The user is given the illusion (or suspended disbelief) of playing an active role in the unraveling video content. We first discuss the overall system architecture, and important components and features of Empatheater. In addition, we report on the results of the experiments that were carried out to evaluate perceived empathy, presence/immersion and subjective user experience with it as compared to conventional passive video viewing for different content genres and forms of interaction.",
keywords = "Immersion, Interactive video, Multimodality, Presence, Subjective user experience, User guidance",
author = "Myunghee Lee and Jeonghyun Kim",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/s12193-014-0151-6",
language = "English",
volume = "8",
pages = "273--288",
journal = "Journal on Multimodal User Interfaces",
issn = "1783-7677",
publisher = "Springer Verlag",
number = "3",

}

TY - JOUR

T1 - Empathetic video clip experience through timely multimodal interaction

AU - Lee, Myunghee

AU - Kim, Jeonghyun

PY - 2014/1/1

Y1 - 2014/1/1

N2 - In this article, we describe a video clip playing system, named “Empatheater,” that is controlled by multimodal interaction. As the video clip is played, the user can interact and emulate predefined video “events” through guidance and multimodal natural interaction (e.g. following the main character’s motion, gestures or voice). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of Empatheater is to provide indirect experience of the given video content by eliciting the user to mimic and empathize with the main character. The user is given the illusion (or suspended disbelief) of playing an active role in the unraveling video content. We first discuss the overall system architecture, and important components and features of Empatheater. In addition, we report on the results of the experiments that were carried out to evaluate perceived empathy, presence/immersion and subjective user experience with it as compared to conventional passive video viewing for different content genres and forms of interaction.

AB - In this article, we describe a video clip playing system, named “Empatheater,” that is controlled by multimodal interaction. As the video clip is played, the user can interact and emulate predefined video “events” through guidance and multimodal natural interaction (e.g. following the main character’s motion, gestures or voice). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of Empatheater is to provide indirect experience of the given video content by eliciting the user to mimic and empathize with the main character. The user is given the illusion (or suspended disbelief) of playing an active role in the unraveling video content. We first discuss the overall system architecture, and important components and features of Empatheater. In addition, we report on the results of the experiments that were carried out to evaluate perceived empathy, presence/immersion and subjective user experience with it as compared to conventional passive video viewing for different content genres and forms of interaction.

KW - Immersion

KW - Interactive video

KW - Multimodality

KW - Presence

KW - Subjective user experience

KW - User guidance

UR - http://www.scopus.com/inward/record.url?scp=84908093681&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908093681&partnerID=8YFLogxK

U2 - 10.1007/s12193-014-0151-6

DO - 10.1007/s12193-014-0151-6

M3 - Article

AN - SCOPUS:84908093681

VL - 8

SP - 273

EP - 288

JO - Journal on Multimodal User Interfaces

JF - Journal on Multimodal User Interfaces

SN - 1783-7677

IS - 3

ER -