PPG and EMG based emotion recognition using convolutional neural network

Min Seop Lee, Ye Ri Cho, Yun Kyu Lee, Dong Sung Pae, Myo Taeg Lim, Tae Koo Kang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

Original languageEnglish
Title of host publicationICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics
EditorsOleg Gusikhin, Kurosh Madani, Janan Zaytoon
PublisherSciTePress
Pages595-600
Number of pages6
ISBN (Electronic)9789897583803
Publication statusPublished - 2019 Jan 1
Event16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019 - Prague, Czech Republic
Duration: 2019 Jul 292019 Jul 31

Publication series

NameICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics
Volume1

Conference

Conference16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019
CountryCzech Republic
CityPrague
Period19/7/2919/7/31

Fingerprint

Human computer interaction
Feature extraction
Neural networks

Keywords

  • Arousal
  • Convolutional neural network
  • EMG
  • Physiological signal
  • PPG
  • Valence

ASJC Scopus subject areas

  • Information Systems
  • Control and Systems Engineering

Cite this

Lee, M. S., Cho, Y. R., Lee, Y. K., Pae, D. S., Lim, M. T., & Kang, T. K. (2019). PPG and EMG based emotion recognition using convolutional neural network. In O. Gusikhin, K. Madani, & J. Zaytoon (Eds.), ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics (pp. 595-600). (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics; Vol. 1). SciTePress.

PPG and EMG based emotion recognition using convolutional neural network. / Lee, Min Seop; Cho, Ye Ri; Lee, Yun Kyu; Pae, Dong Sung; Lim, Myo Taeg; Kang, Tae Koo.

ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. ed. / Oleg Gusikhin; Kurosh Madani; Janan Zaytoon. SciTePress, 2019. p. 595-600 (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics; Vol. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, MS, Cho, YR, Lee, YK, Pae, DS, Lim, MT & Kang, TK 2019, PPG and EMG based emotion recognition using convolutional neural network. in O Gusikhin, K Madani & J Zaytoon (eds), ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics, vol. 1, SciTePress, pp. 595-600, 16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019, Prague, Czech Republic, 19/7/29.
Lee MS, Cho YR, Lee YK, Pae DS, Lim MT, Kang TK. PPG and EMG based emotion recognition using convolutional neural network. In Gusikhin O, Madani K, Zaytoon J, editors, ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. SciTePress. 2019. p. 595-600. (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics).
Lee, Min Seop ; Cho, Ye Ri ; Lee, Yun Kyu ; Pae, Dong Sung ; Lim, Myo Taeg ; Kang, Tae Koo. / PPG and EMG based emotion recognition using convolutional neural network. ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. editor / Oleg Gusikhin ; Kurosh Madani ; Janan Zaytoon. SciTePress, 2019. pp. 595-600 (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics).
@inproceedings{c0ee8bbfe5cf4e2b878e1726432283cb,
title = "PPG and EMG based emotion recognition using convolutional neural network",
abstract = "Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.",
keywords = "Arousal, Convolutional neural network, EMG, Physiological signal, PPG, Valence",
author = "Lee, {Min Seop} and Cho, {Ye Ri} and Lee, {Yun Kyu} and Pae, {Dong Sung} and Lim, {Myo Taeg} and Kang, {Tae Koo}",
year = "2019",
month = "1",
day = "1",
language = "English",
series = "ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics",
publisher = "SciTePress",
pages = "595--600",
editor = "Oleg Gusikhin and Kurosh Madani and Janan Zaytoon",
booktitle = "ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics",

}

TY - GEN

T1 - PPG and EMG based emotion recognition using convolutional neural network

AU - Lee, Min Seop

AU - Cho, Ye Ri

AU - Lee, Yun Kyu

AU - Pae, Dong Sung

AU - Lim, Myo Taeg

AU - Kang, Tae Koo

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

AB - Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

KW - Arousal

KW - Convolutional neural network

KW - EMG

KW - Physiological signal

KW - PPG

KW - Valence

UR - http://www.scopus.com/inward/record.url?scp=85073121968&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073121968&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85073121968

T3 - ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics

SP - 595

EP - 600

BT - ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics

A2 - Gusikhin, Oleg

A2 - Madani, Kurosh

A2 - Zaytoon, Janan

PB - SciTePress

ER -