Improved remote gaze estimation using corneal reflection-adaptive geometric transforms

Chunfei Ma, Seung Jin Baek, Kang A. Choi, Sung-Jea Ko

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Recently, the remote gaze estimation (RGE) technique has been widely applied to consumer devices as a more natural interface. In general, the conventional RGE method estimates a user's point of gaze using a geometric transform, which represents the relationship between several infrared (IR) light sources and their corresponding corneal reflections (CRs) in the eye image. Among various methods, the homography normalization (HN) method achieves state-of-the-art performance. However, the geometric transform of the HN method requiring four CRs is infeasible for the case when fewer than four CRs are available. To solve this problem, this paper proposes a new RGE method based on three alternative geometric transforms, which are adaptive to the number of CRs. Unlike the HN method, the proposed method not only can operate with two or three CRs, but can also provide superior accuracy. To further enhance the performance, an effective error correction method is also proposed. By combining the introduced transforms with the error-correction method, the proposed method not only provides high accuracy and robustness for gaze estimation, but also allows for a more flexible system setup with a different number of IR light sources. Experimental results demonstrate the effectiveness of the proposed method.

Original languageEnglish
Article number053112
JournalOptical Engineering
Volume53
Issue number5
DOIs
Publication statusPublished - 2014 Jan 1

Fingerprint

Error correction
Light sources
light sources
Infrared radiation
estimates

Keywords

  • error correction
  • flexibility
  • geometric transforms
  • remote gaze estimation

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Engineering(all)

Cite this

Improved remote gaze estimation using corneal reflection-adaptive geometric transforms. / Ma, Chunfei; Baek, Seung Jin; Choi, Kang A.; Ko, Sung-Jea.

In: Optical Engineering, Vol. 53, No. 5, 053112, 01.01.2014.

Research output: Contribution to journalArticle

@article{844b42893941457d8411822447a33af6,
title = "Improved remote gaze estimation using corneal reflection-adaptive geometric transforms",
abstract = "Recently, the remote gaze estimation (RGE) technique has been widely applied to consumer devices as a more natural interface. In general, the conventional RGE method estimates a user's point of gaze using a geometric transform, which represents the relationship between several infrared (IR) light sources and their corresponding corneal reflections (CRs) in the eye image. Among various methods, the homography normalization (HN) method achieves state-of-the-art performance. However, the geometric transform of the HN method requiring four CRs is infeasible for the case when fewer than four CRs are available. To solve this problem, this paper proposes a new RGE method based on three alternative geometric transforms, which are adaptive to the number of CRs. Unlike the HN method, the proposed method not only can operate with two or three CRs, but can also provide superior accuracy. To further enhance the performance, an effective error correction method is also proposed. By combining the introduced transforms with the error-correction method, the proposed method not only provides high accuracy and robustness for gaze estimation, but also allows for a more flexible system setup with a different number of IR light sources. Experimental results demonstrate the effectiveness of the proposed method.",
keywords = "error correction, flexibility, geometric transforms, remote gaze estimation",
author = "Chunfei Ma and Baek, {Seung Jin} and Choi, {Kang A.} and Sung-Jea Ko",
year = "2014",
month = "1",
day = "1",
doi = "10.1117/1.OE.53.5.053112",
language = "English",
volume = "53",
journal = "Optical Engineering",
issn = "0091-3286",
publisher = "SPIE",
number = "5",

}

TY - JOUR

T1 - Improved remote gaze estimation using corneal reflection-adaptive geometric transforms

AU - Ma, Chunfei

AU - Baek, Seung Jin

AU - Choi, Kang A.

AU - Ko, Sung-Jea

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Recently, the remote gaze estimation (RGE) technique has been widely applied to consumer devices as a more natural interface. In general, the conventional RGE method estimates a user's point of gaze using a geometric transform, which represents the relationship between several infrared (IR) light sources and their corresponding corneal reflections (CRs) in the eye image. Among various methods, the homography normalization (HN) method achieves state-of-the-art performance. However, the geometric transform of the HN method requiring four CRs is infeasible for the case when fewer than four CRs are available. To solve this problem, this paper proposes a new RGE method based on three alternative geometric transforms, which are adaptive to the number of CRs. Unlike the HN method, the proposed method not only can operate with two or three CRs, but can also provide superior accuracy. To further enhance the performance, an effective error correction method is also proposed. By combining the introduced transforms with the error-correction method, the proposed method not only provides high accuracy and robustness for gaze estimation, but also allows for a more flexible system setup with a different number of IR light sources. Experimental results demonstrate the effectiveness of the proposed method.

AB - Recently, the remote gaze estimation (RGE) technique has been widely applied to consumer devices as a more natural interface. In general, the conventional RGE method estimates a user's point of gaze using a geometric transform, which represents the relationship between several infrared (IR) light sources and their corresponding corneal reflections (CRs) in the eye image. Among various methods, the homography normalization (HN) method achieves state-of-the-art performance. However, the geometric transform of the HN method requiring four CRs is infeasible for the case when fewer than four CRs are available. To solve this problem, this paper proposes a new RGE method based on three alternative geometric transforms, which are adaptive to the number of CRs. Unlike the HN method, the proposed method not only can operate with two or three CRs, but can also provide superior accuracy. To further enhance the performance, an effective error correction method is also proposed. By combining the introduced transforms with the error-correction method, the proposed method not only provides high accuracy and robustness for gaze estimation, but also allows for a more flexible system setup with a different number of IR light sources. Experimental results demonstrate the effectiveness of the proposed method.

KW - error correction

KW - flexibility

KW - geometric transforms

KW - remote gaze estimation

UR - http://www.scopus.com/inward/record.url?scp=84901020253&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901020253&partnerID=8YFLogxK

U2 - 10.1117/1.OE.53.5.053112

DO - 10.1117/1.OE.53.5.053112

M3 - Article

AN - SCOPUS:84901020253

VL - 53

JO - Optical Engineering

JF - Optical Engineering

SN - 0091-3286

IS - 5

M1 - 053112

ER -