Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

Soo Yeon Han, Jeong Woo Kim, Seong Whan Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

Original languageEnglish
Title of host publication7th International Winter Conference on Brain-Computer Interface, BCI 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538681169
DOIs
Publication statusPublished - 2019 Feb 1
Event7th International Winter Conference on Brain-Computer Interface, BCI 2019 - Gangwon, Korea, Republic of
Duration: 2019 Feb 182019 Feb 20

Publication series

Name7th International Winter Conference on Brain-Computer Interface, BCI 2019

Conference

Conference7th International Winter Conference on Brain-Computer Interface, BCI 2019
CountryKorea, Republic of
CityGangwon
Period19/2/1819/2/20

Fingerprint

Human computer interaction
Electroencephalography
Electrocardiography
Statistical methods
Accidents
Fatigue of materials
Mental Fatigue
Technology
Workload
Respiration
Pilots
Safety

Keywords

  • electroencephalography
  • passive brain computer interface
  • peripheral physiological meausrescomponent
  • pilot inattention
  • pilot safety
  • pilot's mental states

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Signal Processing
  • Neuroscience (miscellaneous)

Cite this

Han, S. Y., Kim, J. W., & Lee, S. W. (2019). Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. In 7th International Winter Conference on Brain-Computer Interface, BCI 2019 [8737317] (7th International Winter Conference on Brain-Computer Interface, BCI 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWW-BCI.2019.8737317

Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. / Han, Soo Yeon; Kim, Jeong Woo; Lee, Seong Whan.

7th International Winter Conference on Brain-Computer Interface, BCI 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8737317 (7th International Winter Conference on Brain-Computer Interface, BCI 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Han, SY, Kim, JW & Lee, SW 2019, Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. in 7th International Winter Conference on Brain-Computer Interface, BCI 2019., 8737317, 7th International Winter Conference on Brain-Computer Interface, BCI 2019, Institute of Electrical and Electronics Engineers Inc., 7th International Winter Conference on Brain-Computer Interface, BCI 2019, Gangwon, Korea, Republic of, 19/2/18. https://doi.org/10.1109/IWW-BCI.2019.8737317
Han SY, Kim JW, Lee SW. Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. In 7th International Winter Conference on Brain-Computer Interface, BCI 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8737317. (7th International Winter Conference on Brain-Computer Interface, BCI 2019). https://doi.org/10.1109/IWW-BCI.2019.8737317
Han, Soo Yeon ; Kim, Jeong Woo ; Lee, Seong Whan. / Recognition of Pilot's Cognitive States based on Combination of Physiological Signals. 7th International Winter Conference on Brain-Computer Interface, BCI 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (7th International Winter Conference on Brain-Computer Interface, BCI 2019).
@inproceedings{a13b47cecec34937a7e94e8f8d9cdecc,
title = "Recognition of Pilot's Cognitive States based on Combination of Physiological Signals",
abstract = "Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.",
keywords = "electroencephalography, passive brain computer interface, peripheral physiological meausrescomponent, pilot inattention, pilot safety, pilot's mental states",
author = "Han, {Soo Yeon} and Kim, {Jeong Woo} and Lee, {Seong Whan}",
year = "2019",
month = "2",
day = "1",
doi = "10.1109/IWW-BCI.2019.8737317",
language = "English",
series = "7th International Winter Conference on Brain-Computer Interface, BCI 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "7th International Winter Conference on Brain-Computer Interface, BCI 2019",

}

TY - GEN

T1 - Recognition of Pilot's Cognitive States based on Combination of Physiological Signals

AU - Han, Soo Yeon

AU - Kim, Jeong Woo

AU - Lee, Seong Whan

PY - 2019/2/1

Y1 - 2019/2/1

N2 - Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

AB - Pilot's cognitive states induced by mental fatigue, distraction, and workload could be a cause of catastrophic accidents. Therefore, many methods for the detection of pilot cognitive states have been proposed in previous studies. Especially, neuro-and peripheral physiological measures (PPMs) such as electroencephalogram (EEG), electrocardiogram (ECG), respiration, and electrodermal activity (EDA) were employed to develop the novel flight assistant technologies for assurance of pilot's safety. However, each study investigated only one kind of state. Also, they did not consider the feature optimization for each subject. In this paper, we propose a method for the recognition of pilot's diversified mental states during simulated flight. The method selects the most fitted features for each subject based on the statistical analysis. The results show that the proposed method is superior to previous methods. Consequently, it shows that the pilot assistant system based on human-computer interaction (HCI) technologies could be facilitated in real-world.

KW - electroencephalography

KW - passive brain computer interface

KW - peripheral physiological meausrescomponent

KW - pilot inattention

KW - pilot safety

KW - pilot's mental states

UR - http://www.scopus.com/inward/record.url?scp=85068344963&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068344963&partnerID=8YFLogxK

U2 - 10.1109/IWW-BCI.2019.8737317

DO - 10.1109/IWW-BCI.2019.8737317

M3 - Conference contribution

AN - SCOPUS:85068344963

T3 - 7th International Winter Conference on Brain-Computer Interface, BCI 2019

BT - 7th International Winter Conference on Brain-Computer Interface, BCI 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -