PPG and EMG based emotion recognition using convolutional neural network

Min Seop Lee; Ye Ri Cho; Yun Kyu Lee; Dong Sung Pae; Myo Taeg Lim; Tae Koo Kang

doi:10.5220/0007797005950600

PPG and EMG based emotion recognition using convolutional neural network

Min Seop Lee, Ye Ri Cho, Yun Kyu Lee, Dong Sung Pae, Myo Taeg Lim, Tae Koo Kang

School of Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

Original language	English
Title of host publication	ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics
Editors	Oleg Gusikhin, Kurosh Madani, Janan Zaytoon
Publisher	SciTePress
Pages	595-600
Number of pages	6
ISBN (Electronic)	9789897583803
DOIs	https://doi.org/10.5220/0007797005950600
Publication status	Published - 2019
Event	16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019 - Prague, Czech Republic Duration: 2019 Jul 29 → 2019 Jul 31

Publication series

Name	ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics
Volume	1

Conference

Conference	16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019
Country	Czech Republic
City	Prague
Period	19/7/29 → 19/7/31

Keywords

Arousal
Convolutional neural network
EMG
PPG
Physiological signal
Valence

ASJC Scopus subject areas

Information Systems
Control and Systems Engineering

Access to Document

10.5220/0007797005950600

Fingerprint Dive into the research topics of 'PPG and EMG based emotion recognition using convolutional neural network'. Together they form a unique fingerprint.

Cite this

Lee, M. S., Cho, Y. R., Lee, Y. K., Pae, D. S., Lim, M. T., & Kang, T. K. (2019). PPG and EMG based emotion recognition using convolutional neural network. In O. Gusikhin, K. Madani, & J. Zaytoon (Eds.), ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics (pp. 595-600). (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics; Vol. 1). SciTePress. https://doi.org/10.5220/0007797005950600

PPG and EMG based emotion recognition using convolutional neural network. / Lee, Min Seop; Cho, Ye Ri; Lee, Yun Kyu; Pae, Dong Sung; Lim, Myo Taeg; Kang, Tae Koo.

ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. ed. / Oleg Gusikhin; Kurosh Madani; Janan Zaytoon. SciTePress, 2019. p. 595-600 (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics; Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, MS, Cho, YR, Lee, YK, Pae, DS, Lim, MT & Kang, TK 2019, PPG and EMG based emotion recognition using convolutional neural network. in O Gusikhin, K Madani & J Zaytoon (eds), ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics, vol. 1, SciTePress, pp. 595-600, 16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019, Prague, Czech Republic, 19/7/29. https://doi.org/10.5220/0007797005950600

Lee MS, Cho YR, Lee YK, Pae DS, Lim MT, Kang TK. PPG and EMG based emotion recognition using convolutional neural network. In Gusikhin O, Madani K, Zaytoon J, editors, ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. SciTePress. 2019. p. 595-600. (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics). https://doi.org/10.5220/0007797005950600

Lee, Min Seop ; Cho, Ye Ri ; Lee, Yun Kyu ; Pae, Dong Sung ; Lim, Myo Taeg ; Kang, Tae Koo. / PPG and EMG based emotion recognition using convolutional neural network. ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics. editor / Oleg Gusikhin ; Kurosh Madani ; Janan Zaytoon. SciTePress, 2019. pp. 595-600 (ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics).

@inproceedings{c0ee8bbfe5cf4e2b878e1726432283cb,

title = "PPG and EMG based emotion recognition using convolutional neural network",

abstract = "Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.",

keywords = "Arousal, Convolutional neural network, EMG, PPG, Physiological signal, Valence",

author = "Lee, {Min Seop} and Cho, {Ye Ri} and Lee, {Yun Kyu} and Pae, {Dong Sung} and Lim, {Myo Taeg} and Kang, {Tae Koo}",

year = "2019",

doi = "10.5220/0007797005950600",

language = "English",

series = "ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics",

publisher = "SciTePress",

pages = "595--600",

editor = "Oleg Gusikhin and Kurosh Madani and Janan Zaytoon",

booktitle = "ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics",

note = "16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019 ; Conference date: 29-07-2019 Through 31-07-2019",

}

TY - GEN

T1 - PPG and EMG based emotion recognition using convolutional neural network

AU - Lee, Min Seop

AU - Cho, Ye Ri

AU - Lee, Yun Kyu

AU - Pae, Dong Sung

AU - Lim, Myo Taeg

AU - Kang, Tae Koo

PY - 2019

Y1 - 2019

N2 - Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

AB - Emotion recognition is an essential part of human computer interaction and there are many sources for emotion recognition. In this study, physiological signals, especially electromyogram (EMG) and photoplethysmogram (PPG) are used to detect the emotion. To classify emotions in more detail, the existing method of modeling emotion which represents the emotion as valence and arousal is subdivided by four levels. Convolutional Neural network (CNN) is adopted for feature extraction and emotion classification. We measure the EMG and PPG signals from 30 subjects using selected 32 videos. Our method is evaluated by what we acquired from participants.

KW - Arousal

KW - Convolutional neural network

KW - EMG

KW - PPG

KW - Physiological signal

KW - Valence

UR - http://www.scopus.com/inward/record.url?scp=85073121968&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073121968&partnerID=8YFLogxK

U2 - 10.5220/0007797005950600

DO - 10.5220/0007797005950600

M3 - Conference contribution

AN - SCOPUS:85073121968

T3 - ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics

SP - 595

EP - 600

BT - ICINCO 2019 - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics

A2 - Gusikhin, Oleg

A2 - Madani, Kurosh

A2 - Zaytoon, Janan

PB - SciTePress

T2 - 16th International Conference on Informatics in Control, Automation and Robotics, ICINCO 2019

Y2 - 29 July 2019 through 31 July 2019

ER -