Video viewer state estimation using gaze tracking and video content analysis

Jae Woo Kim, Jong-Ok Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this paper, we propose a novel viewer state model based on gaze tracking and video content analysis. There are two primary contributions in this paper. We first improve gaze state classification significantly by combining video content analysis. Then, based on the estimated gaze state, we propose a novel viewer state model indicating both viewer's interest and existence of viewer's ROIs. Experiments were conducted to verify the performance of the proposed gaze state classifier and viewer state model. The experimental results show that the use of video content analysis in gaze state classification considerably improves the classification results and consequently, the viewer state model correctly estimates the interest state of video viewers.

Original languageEnglish
Title of host publicationIEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing
DOIs
Publication statusPublished - 2013 Dec 1
Event2013 IEEE International Conference on Visual Communications and Image Processing, IEEE VCIP 2013 - Kuching, Sarawak, Malaysia
Duration: 2013 Nov 172013 Nov 20

Other

Other2013 IEEE International Conference on Visual Communications and Image Processing, IEEE VCIP 2013
CountryMalaysia
CityKuching, Sarawak
Period13/11/1713/11/20

Fingerprint

State estimation
Classifiers
Experiments

Keywords

  • gaze state classification
  • gaze tracking
  • region of interest
  • video viewing
  • viewer state

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Kim, J. W., & Kim, J-O. (2013). Video viewer state estimation using gaze tracking and video content analysis. In IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing [6706365] https://doi.org/10.1109/VCIP.2013.6706365

Video viewer state estimation using gaze tracking and video content analysis. / Kim, Jae Woo; Kim, Jong-Ok.

IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing. 2013. 6706365.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, JW & Kim, J-O 2013, Video viewer state estimation using gaze tracking and video content analysis. in IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing., 6706365, 2013 IEEE International Conference on Visual Communications and Image Processing, IEEE VCIP 2013, Kuching, Sarawak, Malaysia, 13/11/17. https://doi.org/10.1109/VCIP.2013.6706365
Kim JW, Kim J-O. Video viewer state estimation using gaze tracking and video content analysis. In IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing. 2013. 6706365 https://doi.org/10.1109/VCIP.2013.6706365
Kim, Jae Woo ; Kim, Jong-Ok. / Video viewer state estimation using gaze tracking and video content analysis. IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing. 2013.
@inproceedings{aa4b1d01918641e0b463d1a29c1b6009,
title = "Video viewer state estimation using gaze tracking and video content analysis",
abstract = "In this paper, we propose a novel viewer state model based on gaze tracking and video content analysis. There are two primary contributions in this paper. We first improve gaze state classification significantly by combining video content analysis. Then, based on the estimated gaze state, we propose a novel viewer state model indicating both viewer's interest and existence of viewer's ROIs. Experiments were conducted to verify the performance of the proposed gaze state classifier and viewer state model. The experimental results show that the use of video content analysis in gaze state classification considerably improves the classification results and consequently, the viewer state model correctly estimates the interest state of video viewers.",
keywords = "gaze state classification, gaze tracking, region of interest, video viewing, viewer state",
author = "Kim, {Jae Woo} and Jong-Ok Kim",
year = "2013",
month = "12",
day = "1",
doi = "10.1109/VCIP.2013.6706365",
language = "English",
isbn = "9781479902903",
booktitle = "IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing",

}

TY - GEN

T1 - Video viewer state estimation using gaze tracking and video content analysis

AU - Kim, Jae Woo

AU - Kim, Jong-Ok

PY - 2013/12/1

Y1 - 2013/12/1

N2 - In this paper, we propose a novel viewer state model based on gaze tracking and video content analysis. There are two primary contributions in this paper. We first improve gaze state classification significantly by combining video content analysis. Then, based on the estimated gaze state, we propose a novel viewer state model indicating both viewer's interest and existence of viewer's ROIs. Experiments were conducted to verify the performance of the proposed gaze state classifier and viewer state model. The experimental results show that the use of video content analysis in gaze state classification considerably improves the classification results and consequently, the viewer state model correctly estimates the interest state of video viewers.

AB - In this paper, we propose a novel viewer state model based on gaze tracking and video content analysis. There are two primary contributions in this paper. We first improve gaze state classification significantly by combining video content analysis. Then, based on the estimated gaze state, we propose a novel viewer state model indicating both viewer's interest and existence of viewer's ROIs. Experiments were conducted to verify the performance of the proposed gaze state classifier and viewer state model. The experimental results show that the use of video content analysis in gaze state classification considerably improves the classification results and consequently, the viewer state model correctly estimates the interest state of video viewers.

KW - gaze state classification

KW - gaze tracking

KW - region of interest

KW - video viewing

KW - viewer state

UR - http://www.scopus.com/inward/record.url?scp=84893654895&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893654895&partnerID=8YFLogxK

U2 - 10.1109/VCIP.2013.6706365

DO - 10.1109/VCIP.2013.6706365

M3 - Conference contribution

AN - SCOPUS:84893654895

SN - 9781479902903

BT - IEEE VCIP 2013 - 2013 IEEE International Conference on Visual Communications and Image Processing

ER -