An example-based face hallucination method for single-frame, low-resolution facial images

Jeong Seon Park, Seong Whan Lee

Research output: Contribution to journalArticle

106 Citations (Scopus)

Abstract

This paper proposes a face hallucination method for the reconstruction of high-resolution facial images from single-frame, low-resolution facial images. The proposed method has been derived from example-based hallucination methods and morphable face models. First, we propose a recursive error back-projection method to compensate for residual errors, and a region-based reconstruction method to preserve characteristics of local facial regions. Then, we define an extended morphable face model, in which an extended face is composed of the interpolated high-resolution face from a given low-resolution face, and its original high-resolution equivalent. Then, the extended face is separated into an extended shape and an extended texture. We performed various hallucination experiments using the MPI, XM2VTS, and KF databases, compared the reconstruction errors, structural similarity index, and recognition rates, and showed the effects of face detection errors and shape estimation errors. The encouraging results demonstrate that the proposed methods can improve the performance of face recognition systems. Especially the proposed method can enhance the resolution of single-frame, low-resolution facial images.

Original languageEnglish
Pages (from-to)1806-1816
Number of pages11
JournalIEEE Transactions on Image Processing
Volume17
Issue number10
DOIs
Publication statusPublished - 2008

Keywords

  • Error back-projection
  • Example-based reconstruction
  • Extended morphable face model
  • Face hallucination
  • Face recognition
  • Region-based reconstruction

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'An example-based face hallucination method for single-frame, low-resolution facial images'. Together they form a unique fingerprint.

  • Cite this