Empathetic video experience through timely multimodal interaction

Myunghee Lee; Gerard J. Kim

doi:10.1145/1891903.1891948

Empathetic video experience through timely multimodal interaction

Myunghee Lee, Gerard J. Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

In this paper, we describe a video playing system, named "Empatheater," that is controlled by multimodal interaction. As the video is played, the user must interact and emulate predefined video "events" through multimodal guidance and whole body interaction (e.g. following the main character's motion or gestures). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of such a system is to provide indirect experience (of the given video content) by eliciting the user to mimic and empathize with the main character. The user is given the illusion (suspended disbelief) of playing an active role in the unraveling video content. We discuss various features of the newly proposed interactive medium. In addition, we report on the results of the pilot study that was carried out to evaluate its user experience compared to passive video viewing and keyboard based video control.

Original language	English
Title of host publication	International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010
DOIs	https://doi.org/10.1145/1891903.1891948
Publication status	Published - 2010
Event	1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 - Beijing, China Duration: 2010 Nov 8 → 2010 Nov 10

Publication series

Name	International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Other

Other	1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010
Country	China
City	Beijing
Period	10/11/8 → 10/11/10

Keywords

empathy
interactive video
multimodality
user experience
user guidance

ASJC Scopus subject areas

Artificial Intelligence
Human-Computer Interaction
Software
Education

Access to Document

10.1145/1891903.1891948

Fingerprint Dive into the research topics of 'Empathetic video experience through timely multimodal interaction'. Together they form a unique fingerprint.

Cite this

Lee, M., & Kim, G. J. (2010). Empathetic video experience through timely multimodal interaction. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 [1891948] (International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010). https://doi.org/10.1145/1891903.1891948

Empathetic video experience through timely multimodal interaction. / Lee, Myunghee; Kim, Gerard J.

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010. 2010. 1891948 (International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, M & Kim, GJ 2010, Empathetic video experience through timely multimodal interaction. in International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010., 1891948, International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010, 1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010, Beijing, China, 10/11/8. https://doi.org/10.1145/1891903.1891948

Lee M, Kim GJ. Empathetic video experience through timely multimodal interaction. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010. 2010. 1891948. (International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010). https://doi.org/10.1145/1891903.1891948

Lee, Myunghee ; Kim, Gerard J. / Empathetic video experience through timely multimodal interaction. International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010. 2010. (International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010).

@inproceedings{c9bc3ddd264f439fb790c065e83191ea,

title = "Empathetic video experience through timely multimodal interaction",

abstract = "In this paper, we describe a video playing system, named {"}Empatheater,{"} that is controlled by multimodal interaction. As the video is played, the user must interact and emulate predefined video {"}events{"} through multimodal guidance and whole body interaction (e.g. following the main character's motion or gestures). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of such a system is to provide indirect experience (of the given video content) by eliciting the user to mimic and empathize with the main character. The user is given the illusion (suspended disbelief) of playing an active role in the unraveling video content. We discuss various features of the newly proposed interactive medium. In addition, we report on the results of the pilot study that was carried out to evaluate its user experience compared to passive video viewing and keyboard based video control.",

keywords = "empathy, interactive video, multimodality, user experience, user guidance",

author = "Myunghee Lee and Kim, {Gerard J.}",

year = "2010",

doi = "10.1145/1891903.1891948",

language = "English",

isbn = "9781450304146",

series = "International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010",

booktitle = "International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010",

note = "1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 ; Conference date: 08-11-2010 Through 10-11-2010",

}

TY - GEN

T1 - Empathetic video experience through timely multimodal interaction

AU - Lee, Myunghee

AU - Kim, Gerard J.

PY - 2010

Y1 - 2010

N2 - In this paper, we describe a video playing system, named "Empatheater," that is controlled by multimodal interaction. As the video is played, the user must interact and emulate predefined video "events" through multimodal guidance and whole body interaction (e.g. following the main character's motion or gestures). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of such a system is to provide indirect experience (of the given video content) by eliciting the user to mimic and empathize with the main character. The user is given the illusion (suspended disbelief) of playing an active role in the unraveling video content. We discuss various features of the newly proposed interactive medium. In addition, we report on the results of the pilot study that was carried out to evaluate its user experience compared to passive video viewing and keyboard based video control.

AB - In this paper, we describe a video playing system, named "Empatheater," that is controlled by multimodal interaction. As the video is played, the user must interact and emulate predefined video "events" through multimodal guidance and whole body interaction (e.g. following the main character's motion or gestures). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of such a system is to provide indirect experience (of the given video content) by eliciting the user to mimic and empathize with the main character. The user is given the illusion (suspended disbelief) of playing an active role in the unraveling video content. We discuss various features of the newly proposed interactive medium. In addition, we report on the results of the pilot study that was carried out to evaluate its user experience compared to passive video viewing and keyboard based video control.

KW - empathy

KW - interactive video

KW - multimodality

KW - user experience

KW - user guidance

UR - http://www.scopus.com/inward/record.url?scp=78650960122&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650960122&partnerID=8YFLogxK

U2 - 10.1145/1891903.1891948

DO - 10.1145/1891903.1891948

M3 - Conference contribution

AN - SCOPUS:78650960122

SN - 9781450304146

T3 - International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

BT - International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

T2 - 1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Y2 - 8 November 2010 through 10 November 2010

ER -