Real-Time Facial Feature Extraction Scheme Using Cascaded Networks

Hyeonwoo Kim, Hyungjoon Kim, Een Jun Hwang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Facial landmarks such as eyes, nose, and mouth are the most prominent feature points on the face. So far, many works have been done for efficiently extracting such landmarks from facial images. Utilizing more feature points for landmark extraction usually requires more processing time, which has been an obstacle to real-time processing or video processing. On the contrary, utilizing a too small number of feature points cannot represent diverse landmark properties such as shape accurately. In this paper, we propose a deep learning based method for extracting popular 68 feature points for facial landmarks quickly and accurately. To do that, we first detect all the faces in the image by using a cascaded structure composed of relatively light Convolution Neural Networks(CNN). Then, we perform facial landmark extraction for each face, which reduces the processing time a lot. We performed several experiments to evaluate the performance of our method. We report some of the results.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538677896
DOIs
Publication statusPublished - 2019 Apr 1
Event2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Kyoto, Japan
Duration: 2019 Feb 272019 Mar 2

Publication series

Name2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

Conference

Conference2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019
CountryJapan
CityKyoto
Period19/2/2719/3/2

Fingerprint

Feature extraction
Processing
Convolution
Neural networks
Experiments

Keywords

  • cascaded structure
  • face alignment
  • face detection
  • Facial landmarks
  • MTCNN
  • real-time extraction

ASJC Scopus subject areas

  • Information Systems and Management
  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems

Cite this

Kim, H., Kim, H., & Hwang, E. J. (2019). Real-Time Facial Feature Extraction Scheme Using Cascaded Networks. In 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings [8679316] (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BIGCOMP.2019.8679316

Real-Time Facial Feature Extraction Scheme Using Cascaded Networks. / Kim, Hyeonwoo; Kim, Hyungjoon; Hwang, Een Jun.

2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8679316 (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, H, Kim, H & Hwang, EJ 2019, Real-Time Facial Feature Extraction Scheme Using Cascaded Networks. in 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings., 8679316, 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019, Kyoto, Japan, 19/2/27. https://doi.org/10.1109/BIGCOMP.2019.8679316
Kim H, Kim H, Hwang EJ. Real-Time Facial Feature Extraction Scheme Using Cascaded Networks. In 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8679316. (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings). https://doi.org/10.1109/BIGCOMP.2019.8679316
Kim, Hyeonwoo ; Kim, Hyungjoon ; Hwang, Een Jun. / Real-Time Facial Feature Extraction Scheme Using Cascaded Networks. 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings).
@inproceedings{cf4c56736b4d4647bc4927f0c6df4e8e,
title = "Real-Time Facial Feature Extraction Scheme Using Cascaded Networks",
abstract = "Facial landmarks such as eyes, nose, and mouth are the most prominent feature points on the face. So far, many works have been done for efficiently extracting such landmarks from facial images. Utilizing more feature points for landmark extraction usually requires more processing time, which has been an obstacle to real-time processing or video processing. On the contrary, utilizing a too small number of feature points cannot represent diverse landmark properties such as shape accurately. In this paper, we propose a deep learning based method for extracting popular 68 feature points for facial landmarks quickly and accurately. To do that, we first detect all the faces in the image by using a cascaded structure composed of relatively light Convolution Neural Networks(CNN). Then, we perform facial landmark extraction for each face, which reduces the processing time a lot. We performed several experiments to evaluate the performance of our method. We report some of the results.",
keywords = "cascaded structure, face alignment, face detection, Facial landmarks, MTCNN, real-time extraction",
author = "Hyeonwoo Kim and Hyungjoon Kim and Hwang, {Een Jun}",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/BIGCOMP.2019.8679316",
language = "English",
series = "2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings",

}

TY - GEN

T1 - Real-Time Facial Feature Extraction Scheme Using Cascaded Networks

AU - Kim, Hyeonwoo

AU - Kim, Hyungjoon

AU - Hwang, Een Jun

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Facial landmarks such as eyes, nose, and mouth are the most prominent feature points on the face. So far, many works have been done for efficiently extracting such landmarks from facial images. Utilizing more feature points for landmark extraction usually requires more processing time, which has been an obstacle to real-time processing or video processing. On the contrary, utilizing a too small number of feature points cannot represent diverse landmark properties such as shape accurately. In this paper, we propose a deep learning based method for extracting popular 68 feature points for facial landmarks quickly and accurately. To do that, we first detect all the faces in the image by using a cascaded structure composed of relatively light Convolution Neural Networks(CNN). Then, we perform facial landmark extraction for each face, which reduces the processing time a lot. We performed several experiments to evaluate the performance of our method. We report some of the results.

AB - Facial landmarks such as eyes, nose, and mouth are the most prominent feature points on the face. So far, many works have been done for efficiently extracting such landmarks from facial images. Utilizing more feature points for landmark extraction usually requires more processing time, which has been an obstacle to real-time processing or video processing. On the contrary, utilizing a too small number of feature points cannot represent diverse landmark properties such as shape accurately. In this paper, we propose a deep learning based method for extracting popular 68 feature points for facial landmarks quickly and accurately. To do that, we first detect all the faces in the image by using a cascaded structure composed of relatively light Convolution Neural Networks(CNN). Then, we perform facial landmark extraction for each face, which reduces the processing time a lot. We performed several experiments to evaluate the performance of our method. We report some of the results.

KW - cascaded structure

KW - face alignment

KW - face detection

KW - Facial landmarks

KW - MTCNN

KW - real-time extraction

UR - http://www.scopus.com/inward/record.url?scp=85064597565&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064597565&partnerID=8YFLogxK

U2 - 10.1109/BIGCOMP.2019.8679316

DO - 10.1109/BIGCOMP.2019.8679316

M3 - Conference contribution

AN - SCOPUS:85064597565

T3 - 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

BT - 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -