Short paper: Virtual storyteller in immersive virtual environments using fairy tales annotated for emotion states

I. V. Alexandrova, E. P. Volkova, U. Kloos, H. H. Bülthoff, B. J. Mohler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper describes the implementation of an automatically generated virtual storyteller from fairy tale texts which were previously annotated for emotion. In order to gain insight into the effectiveness of our virtual storyteller we recorded face, body and voice of an amateur actor and created an actor animation video of one of the fairy tales. We also got the actor's annotation of the fairy tale text and used this to create a virtual storyteller video. With these two videos, the virtual storyteller and the actor animation, we conducted a user study to determine the effectiveness of our virtual storyteller at conveying the intended emotions of the actor. Encouragingly, participants performed best (when compared to the intended emotions of the actor) when they marked the emotions of the virtual storyteller. Interestingly, the actor himself was not able to annotate the animated actor video with high accuracy as compared to his annotated text. This argues that for future work we must have our actors also annotate their body and facial expressions, not just the text, in order to further investigate the effectiveness of our virtual storyteller. This research is a first step towards using our virtual storyteller in real-time immersive virtual environments.

Original languageEnglish
Title of host publicationJoint Virtual Reality Conf. of EGVE 2010 - The 16th Eurographics Symposium on Virtual Environments, EuroVR 2010 - The 7th EuroVR (INTUITION) Conf., VEC 2010 - The Annual Virtual Efficiency Congr.
Pages65-68
Number of pages4
DOIs
Publication statusPublished - 2010
Event2nd Joint Virtual Reality Conf., JVRC 2010 of 16th Eurographics Symp. on Virtual Environments, EGVE 2010 and the 7th Conf. of the European Association of Virtual Reality and Augmented Reality, EuroVR 2011 and the Annual Virtual Efficiency Congr., VEC - Stuttgart, Germany
Duration: 2010 Sep 272010 Oct 1

Publication series

NameJoint Virtual Reality Conf. of EGVE 2010 - The 16th Eurographics Symposium on Virtual Environments, EuroVR 2010 - The 7th EuroVR (INTUITION) Conf., VEC 2010 - The Annual Virtual Efficiency Congress

Other

Other2nd Joint Virtual Reality Conf., JVRC 2010 of 16th Eurographics Symp. on Virtual Environments, EGVE 2010 and the 7th Conf. of the European Association of Virtual Reality and Augmented Reality, EuroVR 2011 and the Annual Virtual Efficiency Congr., VEC
CountryGermany
CityStuttgart
Period10/9/2710/10/1

Keywords

  • Augmented reality and virtual reality
  • Storytelling
  • Virtual humans

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Short paper: Virtual storyteller in immersive virtual environments using fairy tales annotated for emotion states'. Together they form a unique fingerprint.

Cite this