Semantic 3D motion retargeting for facial animation

Cristóbal Curio, Martin Breidt, Mario Kleiner, Quoc C. Vuong, Martin A. Giese, Heinrich H. Bülthoff

Research output: Chapter in Book/Report/Conference proceedingConference contribution

36 Citations (Scopus)

Abstract

We present a system for realistic facial animation that decomposes facial motion capture data into semantically meaningful motion channels based on the Facial Action Coding System. A captured performance is retargeted onto a morphable 3D face model based on a semantic correspondence between motion capture and 3D scan data. The resulting facial animation reveals a high level of realism by combining the high spatial resolution of a 3D scanner with the high temporal accuracy of motion capture data that accounts for subtle facial movements with sparse measurements. Such an animation system allows us to systematically investigate human perception of moving faces. It offers control over many aspects of the appearance of a dynamic face, while utilizing as much measured data as possible to avoid artistic biases. Using our animation system, we report results of an experiment that investigates the perceived naturalness of facial motion in a preference task. For expressions with small amounts of head motion, we find a benefit for our part-based generative animation system over an example-based approach that deforms the whole face at once.

Original languageEnglish
Title of host publicationProceedings - APGV 2006
Subtitle of host publicationSymposium on Applied Perception in Graphics and Visualization
Pages77-84
Number of pages8
DOIs
Publication statusPublished - 2006
Event3rd Symposium on Applied Perception in Graphics and Visualization, APGV 2006 - Boston, MA, United States
Duration: 2006 Jul 282006 Jul 29

Publication series

NameProceedings - APGV 2006: Symposium on Applied Perception in Graphics and Visualization

Other

Other3rd Symposium on Applied Perception in Graphics and Visualization, APGV 2006
CountryUnited States
CityBoston, MA
Period06/7/2806/7/29

Keywords

  • Facial animation
  • Facial motion
  • Human perception
  • Motion retargeting
  • Performance capture

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Semantic 3D motion retargeting for facial animation'. Together they form a unique fingerprint.

  • Cite this

    Curio, C., Breidt, M., Kleiner, M., Vuong, Q. C., Giese, M. A., & Bülthoff, H. H. (2006). Semantic 3D motion retargeting for facial animation. In Proceedings - APGV 2006: Symposium on Applied Perception in Graphics and Visualization (pp. 77-84). (Proceedings - APGV 2006: Symposium on Applied Perception in Graphics and Visualization). https://doi.org/10.1145/1140491.1140508