Abstract
In this paper, we describe a video playing system, named "Empatheater," that is controlled by multimodal interaction. As the video is played, the user must interact and emulate predefined video "events" through multimodal guidance and whole body interaction (e.g. following the main character's motion or gestures). Without the timely interaction, the video stops. The system shows guidance information as how to properly react and continue the video playing. The purpose of such a system is to provide indirect experience (of the given video content) by eliciting the user to mimic and empathize with the main character. The user is given the illusion (suspended disbelief) of playing an active role in the unraveling video content. We discuss various features of the newly proposed interactive medium. In addition, we report on the results of the pilot study that was carried out to evaluate its user experience compared to passive video viewing and keyboard based video control.
| Original language | English |
|---|---|
| Title of host publication | International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 |
| DOIs | |
| Publication status | Published - 2010 Dec 1 |
| Event | 1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 - Beijing, China Duration: 2010 Nov 8 → 2010 Nov 10 |
Other
| Other | 1st International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010 |
|---|---|
| Country | China |
| City | Beijing |
| Period | 10/11/8 → 10/11/10 |
Keywords
- empathy
- interactive video
- multimodality
- user experience
- user guidance
ASJC Scopus subject areas
- Artificial Intelligence
- Human-Computer Interaction
- Software
- Education