Real time 3D avatar for interactive mixed reality

Sang Yup Lee, Ig Jae Kim, Sang C. Ahn, Heedong Ko, Myo Taeg Lim, Hyoung Gon Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)

Abstract

This paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are often restricted to views from the cameras. True navigation through such mixed reality scenes becomes impossible unless the components from real objects can be rendered from arbitrary viewpoints. Additionally, adding a real-world object to a virtual scene requires some depth information as well, in order to handle interaction. The proposed algorithm introduces an approach to generate 3D video avatars and to augment the avatars naturally into 3D virtual environment using the calibrated camera parameters and silhouette information. As a result, we can create photo-realistic live avatars from natural scenes and the resulting 3D live avatar can guide and interact participants in VR space.

Original languageEnglish
Title of host publicationProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry
Pages75-80
Number of pages6
Publication statusPublished - 2004 Dec 20
EventProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry - , Singapore
Duration: 2004 Jun 162004 Jun 18

Other

OtherProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry
CountrySingapore
Period04/6/1604/6/18

Fingerprint

Cameras
Computer graphics
Virtual reality
Navigation

Keywords

  • 3D reconstruction
  • Image based rendering
  • Interaction
  • IR keying
  • Mixed reality

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Lee, S. Y., Kim, I. J., Ahn, S. C., Ko, H., Lim, M. T., & Kim, H. G. (2004). Real time 3D avatar for interactive mixed reality. In Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (pp. 75-80)

Real time 3D avatar for interactive mixed reality. / Lee, Sang Yup; Kim, Ig Jae; Ahn, Sang C.; Ko, Heedong; Lim, Myo Taeg; Kim, Hyoung Gon.

Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. p. 75-80.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, SY, Kim, IJ, Ahn, SC, Ko, H, Lim, MT & Kim, HG 2004, Real time 3D avatar for interactive mixed reality. in Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. pp. 75-80, Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry, Singapore, 04/6/16.
Lee SY, Kim IJ, Ahn SC, Ko H, Lim MT, Kim HG. Real time 3D avatar for interactive mixed reality. In Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. p. 75-80
Lee, Sang Yup ; Kim, Ig Jae ; Ahn, Sang C. ; Ko, Heedong ; Lim, Myo Taeg ; Kim, Hyoung Gon. / Real time 3D avatar for interactive mixed reality. Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. pp. 75-80
@inproceedings{85a3cf020ce7417ea46bf6fbc36c3a9b,
title = "Real time 3D avatar for interactive mixed reality",
abstract = "This paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are often restricted to views from the cameras. True navigation through such mixed reality scenes becomes impossible unless the components from real objects can be rendered from arbitrary viewpoints. Additionally, adding a real-world object to a virtual scene requires some depth information as well, in order to handle interaction. The proposed algorithm introduces an approach to generate 3D video avatars and to augment the avatars naturally into 3D virtual environment using the calibrated camera parameters and silhouette information. As a result, we can create photo-realistic live avatars from natural scenes and the resulting 3D live avatar can guide and interact participants in VR space.",
keywords = "3D reconstruction, Image based rendering, Interaction, IR keying, Mixed reality",
author = "Lee, {Sang Yup} and Kim, {Ig Jae} and Ahn, {Sang C.} and Heedong Ko and Lim, {Myo Taeg} and Kim, {Hyoung Gon}",
year = "2004",
month = "12",
day = "20",
language = "English",
isbn = "1581138849",
pages = "75--80",
booktitle = "Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry",

}

TY - GEN

T1 - Real time 3D avatar for interactive mixed reality

AU - Lee, Sang Yup

AU - Kim, Ig Jae

AU - Ahn, Sang C.

AU - Ko, Heedong

AU - Lim, Myo Taeg

AU - Kim, Hyoung Gon

PY - 2004/12/20

Y1 - 2004/12/20

N2 - This paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are often restricted to views from the cameras. True navigation through such mixed reality scenes becomes impossible unless the components from real objects can be rendered from arbitrary viewpoints. Additionally, adding a real-world object to a virtual scene requires some depth information as well, in order to handle interaction. The proposed algorithm introduces an approach to generate 3D video avatars and to augment the avatars naturally into 3D virtual environment using the calibrated camera parameters and silhouette information. As a result, we can create photo-realistic live avatars from natural scenes and the resulting 3D live avatar can guide and interact participants in VR space.

AB - This paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are often restricted to views from the cameras. True navigation through such mixed reality scenes becomes impossible unless the components from real objects can be rendered from arbitrary viewpoints. Additionally, adding a real-world object to a virtual scene requires some depth information as well, in order to handle interaction. The proposed algorithm introduces an approach to generate 3D video avatars and to augment the avatars naturally into 3D virtual environment using the calibrated camera parameters and silhouette information. As a result, we can create photo-realistic live avatars from natural scenes and the resulting 3D live avatar can guide and interact participants in VR space.

KW - 3D reconstruction

KW - Image based rendering

KW - Interaction

KW - IR keying

KW - Mixed reality

UR - http://www.scopus.com/inward/record.url?scp=10044220730&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10044220730&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:10044220730

SN - 1581138849

SN - 9781581138849

SP - 75

EP - 80

BT - Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry

ER -