Emotion recognition with short-period physiological signals using bimodal sparse autoencoders

Yun Kyu Lee, Dong Sung Pae, Dae Ki Hong, Myo Taeg Lim, Tae Koo Kang

Research output: Contribution to journalArticlepeer-review

Abstract

With the advancement of human-computer interaction and artificial intelligence, emotion recognition has received significant research attention. The most commonly used technique for emotion recognition is EEG, which is directly associated with the central nervous system and contains strong emotional features. However, there are some disadvantages to using EEG signals. They require high dimensionality, diverse and complex processing procedures which make real-time computation difficult. In addition, there are problems in data acquisition and interpretation due to body movement or reduced concentration of the experimenter. In this paper, we used photoplethysmography (PPG) and electromyography (EMG) to record signals. Firstly, we segmented the emotion data into 10-pulses during preprocessing to identify emotions with short period signals. These segmented data were input to the proposed bimodal stacked sparse auto-encoder model. To enhance recognition performance, we adopted a bimodal structure to extract shared PPG and EMG representations. This approach provided more detailed arousal-valence mapping compared with the current high/low binary classification. We created a dataset of PPG and EMG signals, called the emotion dataset dividing into four classes to help understand emotion levels. We achieved high performance of 80.18% and 75.86% for arousal and valence, respectively, despite more class classification. Experimental results validated that the proposed method significantly enhanced emotion recognition performance.

Original languageEnglish
Pages (from-to)657-673
Number of pages17
JournalIntelligent Automation and Soft Computing
Volume32
Issue number2
DOIs
Publication statusPublished - 2022

Keywords

  • Bimodal structure network
  • EDPE dataset
  • Emotion recognition
  • Physiological signal
  • Stacked sparse autoencoder

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Computational Theory and Mathematics
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Emotion recognition with short-period physiological signals using bimodal sparse autoencoders'. Together they form a unique fingerprint.

Cite this