Robust remote gaze estimation method based on multiple geometric transforms

Chunfei Ma, Kang A. Choi, Byeong Doo Choi, Sung-Jea Ko

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The remote gaze estimation (RGE) technique has been widely used as a natural interface in consumer electronic devices for decades. Although outstanding outcomes on RGE have been recently reported in the literature, tracking gaze under large head movements is still an unsolved problem. General RGE methods estimate a user's point of gaze (POG) using a mapping function representing the relationship between several infrared light sources and their corresponding corneal reflections (CRs) in the eye image. However, the minimum number of available CRs required for a valid POG estimation cannot be satisfied in those methods because the CRs often tend to be distorted or disappeared inevitably under the unconstrained eye and head movements. To overcome this problem, a multiple-transform-based method is proposed. In the proposed method, through three different geometric transform-based normalization processes, several nonlinear mapping functions are simultaneously obtained in the calibration process and then used to estimate the POG. The geometric transforms and mapping functions can be alternatively employed according to the number of available CRs even under large head movement. Experimental results on six subjects demonstrate the effectiveness of the proposed method.

Original languageEnglish
Article number083103
JournalOptical Engineering
Volume54
Issue number8
DOIs
Publication statusPublished - 2015 Aug 1

Fingerprint

head movement
Mathematical transformations
eye movements
Consumer electronics
estimates
Light sources
light sources
Calibration
Infrared radiation
electronics

Keywords

  • large head movement
  • multiple geometric transforms
  • reliability
  • remote gaze estimation
  • robustness

ASJC Scopus subject areas

  • Atomic and Molecular Physics, and Optics
  • Engineering(all)

Cite this

Robust remote gaze estimation method based on multiple geometric transforms. / Ma, Chunfei; Choi, Kang A.; Choi, Byeong Doo; Ko, Sung-Jea.

In: Optical Engineering, Vol. 54, No. 8, 083103, 01.08.2015.

Research output: Contribution to journalArticle

Ma, Chunfei ; Choi, Kang A. ; Choi, Byeong Doo ; Ko, Sung-Jea. / Robust remote gaze estimation method based on multiple geometric transforms. In: Optical Engineering. 2015 ; Vol. 54, No. 8.
@article{5bc54c2619a949548dc4da225a059788,
title = "Robust remote gaze estimation method based on multiple geometric transforms",
abstract = "The remote gaze estimation (RGE) technique has been widely used as a natural interface in consumer electronic devices for decades. Although outstanding outcomes on RGE have been recently reported in the literature, tracking gaze under large head movements is still an unsolved problem. General RGE methods estimate a user's point of gaze (POG) using a mapping function representing the relationship between several infrared light sources and their corresponding corneal reflections (CRs) in the eye image. However, the minimum number of available CRs required for a valid POG estimation cannot be satisfied in those methods because the CRs often tend to be distorted or disappeared inevitably under the unconstrained eye and head movements. To overcome this problem, a multiple-transform-based method is proposed. In the proposed method, through three different geometric transform-based normalization processes, several nonlinear mapping functions are simultaneously obtained in the calibration process and then used to estimate the POG. The geometric transforms and mapping functions can be alternatively employed according to the number of available CRs even under large head movement. Experimental results on six subjects demonstrate the effectiveness of the proposed method.",
keywords = "large head movement, multiple geometric transforms, reliability, remote gaze estimation, robustness",
author = "Chunfei Ma and Choi, {Kang A.} and Choi, {Byeong Doo} and Sung-Jea Ko",
year = "2015",
month = "8",
day = "1",
doi = "10.1117/1.OE.54.8.083103",
language = "English",
volume = "54",
journal = "Optical Engineering",
issn = "0091-3286",
publisher = "SPIE",
number = "8",

}

TY - JOUR

T1 - Robust remote gaze estimation method based on multiple geometric transforms

AU - Ma, Chunfei

AU - Choi, Kang A.

AU - Choi, Byeong Doo

AU - Ko, Sung-Jea

PY - 2015/8/1

Y1 - 2015/8/1

N2 - The remote gaze estimation (RGE) technique has been widely used as a natural interface in consumer electronic devices for decades. Although outstanding outcomes on RGE have been recently reported in the literature, tracking gaze under large head movements is still an unsolved problem. General RGE methods estimate a user's point of gaze (POG) using a mapping function representing the relationship between several infrared light sources and their corresponding corneal reflections (CRs) in the eye image. However, the minimum number of available CRs required for a valid POG estimation cannot be satisfied in those methods because the CRs often tend to be distorted or disappeared inevitably under the unconstrained eye and head movements. To overcome this problem, a multiple-transform-based method is proposed. In the proposed method, through three different geometric transform-based normalization processes, several nonlinear mapping functions are simultaneously obtained in the calibration process and then used to estimate the POG. The geometric transforms and mapping functions can be alternatively employed according to the number of available CRs even under large head movement. Experimental results on six subjects demonstrate the effectiveness of the proposed method.

AB - The remote gaze estimation (RGE) technique has been widely used as a natural interface in consumer electronic devices for decades. Although outstanding outcomes on RGE have been recently reported in the literature, tracking gaze under large head movements is still an unsolved problem. General RGE methods estimate a user's point of gaze (POG) using a mapping function representing the relationship between several infrared light sources and their corresponding corneal reflections (CRs) in the eye image. However, the minimum number of available CRs required for a valid POG estimation cannot be satisfied in those methods because the CRs often tend to be distorted or disappeared inevitably under the unconstrained eye and head movements. To overcome this problem, a multiple-transform-based method is proposed. In the proposed method, through three different geometric transform-based normalization processes, several nonlinear mapping functions are simultaneously obtained in the calibration process and then used to estimate the POG. The geometric transforms and mapping functions can be alternatively employed according to the number of available CRs even under large head movement. Experimental results on six subjects demonstrate the effectiveness of the proposed method.

KW - large head movement

KW - multiple geometric transforms

KW - reliability

KW - remote gaze estimation

KW - robustness

UR - http://www.scopus.com/inward/record.url?scp=84939249873&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939249873&partnerID=8YFLogxK

U2 - 10.1117/1.OE.54.8.083103

DO - 10.1117/1.OE.54.8.083103

M3 - Article

AN - SCOPUS:84939249873

VL - 54

JO - Optical Engineering

JF - Optical Engineering

SN - 0091-3286

IS - 8

M1 - 083103

ER -