Noniterative 3D face reconstruction based on photometric stereo

Sang Woong Lee, Patrick S P Wang, Svetlana N. Yanushkevich, Seong Whan Lee

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

3D face reconstruction is a popular area within the computer vision domain. 3D face reconstruction should ideally be achieved easily and cost-effectively, without requiring specialized equipment to estimate 3D shapes. As a result of this, many techniques for retrieving 3D shapes from 2D images have been proposed. In this paper, a novel method for 3D face reconstruction based on photometric stereo, which estimates the surface normal from shading information in multiple images, hence recovering the 3D shape of a face, is proposed. In order to overcome the problems of previous approaches related to prior-knowledge regarding lighting conditions and iterative algorithms, the exemplar is synthesized with known lighting conditions from at least three images, under arbitrary lighting conditions and using an illumination reference. Experiments in 3D face reconstruction were made by verifying the proposed approach using the illumination subset of the Max-Planck Institute face database and Yale face database B. Experimental results demonstrate that the proposed method is effective for 3D shape reconstruction of faces from 2D images.

Original languageEnglish
Pages (from-to)389-410
Number of pages22
JournalInternational Journal of Pattern Recognition and Artificial Intelligence
Volume22
Issue number3
DOIs
Publication statusPublished - 2008 May 1

Fingerprint

Lighting
Computer vision
Costs
Experiments

Keywords

  • 3D face reconstruction
  • Face synthesis
  • Illuminated exemplar
  • Photometric stereo

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Cite this

Noniterative 3D face reconstruction based on photometric stereo. / Lee, Sang Woong; Wang, Patrick S P; Yanushkevich, Svetlana N.; Lee, Seong Whan.

In: International Journal of Pattern Recognition and Artificial Intelligence, Vol. 22, No. 3, 01.05.2008, p. 389-410.

Research output: Contribution to journalArticle

Lee, Sang Woong ; Wang, Patrick S P ; Yanushkevich, Svetlana N. ; Lee, Seong Whan. / Noniterative 3D face reconstruction based on photometric stereo. In: International Journal of Pattern Recognition and Artificial Intelligence. 2008 ; Vol. 22, No. 3. pp. 389-410.
@article{983a7b73b0d54726a89f04b65818668e,
title = "Noniterative 3D face reconstruction based on photometric stereo",
abstract = "3D face reconstruction is a popular area within the computer vision domain. 3D face reconstruction should ideally be achieved easily and cost-effectively, without requiring specialized equipment to estimate 3D shapes. As a result of this, many techniques for retrieving 3D shapes from 2D images have been proposed. In this paper, a novel method for 3D face reconstruction based on photometric stereo, which estimates the surface normal from shading information in multiple images, hence recovering the 3D shape of a face, is proposed. In order to overcome the problems of previous approaches related to prior-knowledge regarding lighting conditions and iterative algorithms, the exemplar is synthesized with known lighting conditions from at least three images, under arbitrary lighting conditions and using an illumination reference. Experiments in 3D face reconstruction were made by verifying the proposed approach using the illumination subset of the Max-Planck Institute face database and Yale face database B. Experimental results demonstrate that the proposed method is effective for 3D shape reconstruction of faces from 2D images.",
keywords = "3D face reconstruction, Face synthesis, Illuminated exemplar, Photometric stereo",
author = "Lee, {Sang Woong} and Wang, {Patrick S P} and Yanushkevich, {Svetlana N.} and Lee, {Seong Whan}",
year = "2008",
month = "5",
day = "1",
doi = "10.1142/S0218001408006272",
language = "English",
volume = "22",
pages = "389--410",
journal = "International Journal of Pattern Recognition and Artificial Intelligence",
issn = "0218-0014",
publisher = "World Scientific Publishing Co. Pte Ltd",
number = "3",

}

TY - JOUR

T1 - Noniterative 3D face reconstruction based on photometric stereo

AU - Lee, Sang Woong

AU - Wang, Patrick S P

AU - Yanushkevich, Svetlana N.

AU - Lee, Seong Whan

PY - 2008/5/1

Y1 - 2008/5/1

N2 - 3D face reconstruction is a popular area within the computer vision domain. 3D face reconstruction should ideally be achieved easily and cost-effectively, without requiring specialized equipment to estimate 3D shapes. As a result of this, many techniques for retrieving 3D shapes from 2D images have been proposed. In this paper, a novel method for 3D face reconstruction based on photometric stereo, which estimates the surface normal from shading information in multiple images, hence recovering the 3D shape of a face, is proposed. In order to overcome the problems of previous approaches related to prior-knowledge regarding lighting conditions and iterative algorithms, the exemplar is synthesized with known lighting conditions from at least three images, under arbitrary lighting conditions and using an illumination reference. Experiments in 3D face reconstruction were made by verifying the proposed approach using the illumination subset of the Max-Planck Institute face database and Yale face database B. Experimental results demonstrate that the proposed method is effective for 3D shape reconstruction of faces from 2D images.

AB - 3D face reconstruction is a popular area within the computer vision domain. 3D face reconstruction should ideally be achieved easily and cost-effectively, without requiring specialized equipment to estimate 3D shapes. As a result of this, many techniques for retrieving 3D shapes from 2D images have been proposed. In this paper, a novel method for 3D face reconstruction based on photometric stereo, which estimates the surface normal from shading information in multiple images, hence recovering the 3D shape of a face, is proposed. In order to overcome the problems of previous approaches related to prior-knowledge regarding lighting conditions and iterative algorithms, the exemplar is synthesized with known lighting conditions from at least three images, under arbitrary lighting conditions and using an illumination reference. Experiments in 3D face reconstruction were made by verifying the proposed approach using the illumination subset of the Max-Planck Institute face database and Yale face database B. Experimental results demonstrate that the proposed method is effective for 3D shape reconstruction of faces from 2D images.

KW - 3D face reconstruction

KW - Face synthesis

KW - Illuminated exemplar

KW - Photometric stereo

UR - http://www.scopus.com/inward/record.url?scp=44349127838&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44349127838&partnerID=8YFLogxK

U2 - 10.1142/S0218001408006272

DO - 10.1142/S0218001408006272

M3 - Article

AN - SCOPUS:44349127838

VL - 22

SP - 389

EP - 410

JO - International Journal of Pattern Recognition and Artificial Intelligence

JF - International Journal of Pattern Recognition and Artificial Intelligence

SN - 0218-0014

IS - 3

ER -