Face reconstruction from partial information based on a morphable face model

Bon Woo Hwang, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a method for reconstructing a whole face image from partial information based on a morphable face model. Faces are modeled by linear combinations of prototypes of shape and texture. With the shape and texture information of pixels in an given region, we can estimate optimal coefficients for linear combinations of prototypes of shape and texture. In such an over-determined condition, where the number of pixels in the given region is greater than the number of prototypes, we find an optimal solution using projection for least square minimization(LSM). Our experimental results show that reconstructed faces are very natural and plausible like real photos. We interpret the encouraging performance of our proposed method as evidence in support of the hypothesis that the human visual system may reconstruct an whole information from partial information using prototypical examples.

Original languageEnglish
Title of host publicationBiologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings
PublisherSpringer Verlag
Pages501-510
Number of pages10
Volume2525
ISBN (Print)9783540001744
Publication statusPublished - 2002
Event2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002 - Tubingen, Germany
Duration: 2002 Nov 222002 Nov 24

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume2525
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002
CountryGermany
CityTubingen
Period02/11/2202/11/24

Fingerprint

Partial Information
Texture
Textures
Face
Prototype
Linear Combination
Pixel
Pixels
Human Visual System
Least Squares
Optimal Solution
Projection
Model
Experimental Results
Coefficient
Estimate

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Hwang, B. W., & Lee, S. W. (2002). Face reconstruction from partial information based on a morphable face model. In Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings (Vol. 2525, pp. 501-510). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2525). Springer Verlag.

Face reconstruction from partial information based on a morphable face model. / Hwang, Bon Woo; Lee, Seong Whan.

Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. Vol. 2525 Springer Verlag, 2002. p. 501-510 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2525).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hwang, BW & Lee, SW 2002, Face reconstruction from partial information based on a morphable face model. in Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. vol. 2525, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 2525, Springer Verlag, pp. 501-510, 2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002, Tubingen, Germany, 02/11/22.
Hwang BW, Lee SW. Face reconstruction from partial information based on a morphable face model. In Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. Vol. 2525. Springer Verlag. 2002. p. 501-510. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Hwang, Bon Woo ; Lee, Seong Whan. / Face reconstruction from partial information based on a morphable face model. Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. Vol. 2525 Springer Verlag, 2002. pp. 501-510 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{744f0b3a40704b6e863d24f4237ba7bb,
title = "Face reconstruction from partial information based on a morphable face model",
abstract = "This paper proposes a method for reconstructing a whole face image from partial information based on a morphable face model. Faces are modeled by linear combinations of prototypes of shape and texture. With the shape and texture information of pixels in an given region, we can estimate optimal coefficients for linear combinations of prototypes of shape and texture. In such an over-determined condition, where the number of pixels in the given region is greater than the number of prototypes, we find an optimal solution using projection for least square minimization(LSM). Our experimental results show that reconstructed faces are very natural and plausible like real photos. We interpret the encouraging performance of our proposed method as evidence in support of the hypothesis that the human visual system may reconstruct an whole information from partial information using prototypical examples.",
author = "Hwang, {Bon Woo} and Lee, {Seong Whan}",
year = "2002",
language = "English",
isbn = "9783540001744",
volume = "2525",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "501--510",
booktitle = "Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings",

}

TY - GEN

T1 - Face reconstruction from partial information based on a morphable face model

AU - Hwang, Bon Woo

AU - Lee, Seong Whan

PY - 2002

Y1 - 2002

N2 - This paper proposes a method for reconstructing a whole face image from partial information based on a morphable face model. Faces are modeled by linear combinations of prototypes of shape and texture. With the shape and texture information of pixels in an given region, we can estimate optimal coefficients for linear combinations of prototypes of shape and texture. In such an over-determined condition, where the number of pixels in the given region is greater than the number of prototypes, we find an optimal solution using projection for least square minimization(LSM). Our experimental results show that reconstructed faces are very natural and plausible like real photos. We interpret the encouraging performance of our proposed method as evidence in support of the hypothesis that the human visual system may reconstruct an whole information from partial information using prototypical examples.

AB - This paper proposes a method for reconstructing a whole face image from partial information based on a morphable face model. Faces are modeled by linear combinations of prototypes of shape and texture. With the shape and texture information of pixels in an given region, we can estimate optimal coefficients for linear combinations of prototypes of shape and texture. In such an over-determined condition, where the number of pixels in the given region is greater than the number of prototypes, we find an optimal solution using projection for least square minimization(LSM). Our experimental results show that reconstructed faces are very natural and plausible like real photos. We interpret the encouraging performance of our proposed method as evidence in support of the hypothesis that the human visual system may reconstruct an whole information from partial information using prototypical examples.

UR - http://www.scopus.com/inward/record.url?scp=84931450418&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84931450418&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9783540001744

VL - 2525

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 501

EP - 510

BT - Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings

PB - Springer Verlag

ER -