Decoding of human memory formation with EEG signals using convolutional networks

Taeho Kang, Yiyu Chen, Siamac Fazli, Christian Wallraven

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

Original languageEnglish
Title of host publication2018 6th International Conference on Brain-Computer Interface, BCI 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-5
Number of pages5
Volume2018-January
ISBN (Electronic)9781538625743
DOIs
Publication statusPublished - 2018 Mar 9
Event6th International Conference on Brain-Computer Interface, BCI 2018 - GangWon, Korea, Republic of
Duration: 2018 Jan 152018 Jan 17

Other

Other6th International Conference on Brain-Computer Interface, BCI 2018
CountryKorea, Republic of
CityGangWon
Period18/1/1518/1/17

Fingerprint

Electroencephalography
Decoding
Brain
Learning
Data storage equipment
Vocabulary
Discriminant Analysis
Discriminant analysis
Statistical methods
Language
Neural networks
Deep neural networks
Retention (Psychology)

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Behavioral Neuroscience

Cite this

Kang, T., Chen, Y., Fazli, S., & Wallraven, C. (2018). Decoding of human memory formation with EEG signals using convolutional networks. In 2018 6th International Conference on Brain-Computer Interface, BCI 2018 (Vol. 2018-January, pp. 1-5). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWW-BCI.2018.8311487

Decoding of human memory formation with EEG signals using convolutional networks. / Kang, Taeho; Chen, Yiyu; Fazli, Siamac; Wallraven, Christian.

2018 6th International Conference on Brain-Computer Interface, BCI 2018. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-5.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kang, T, Chen, Y, Fazli, S & Wallraven, C 2018, Decoding of human memory formation with EEG signals using convolutional networks. in 2018 6th International Conference on Brain-Computer Interface, BCI 2018. vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 1-5, 6th International Conference on Brain-Computer Interface, BCI 2018, GangWon, Korea, Republic of, 18/1/15. https://doi.org/10.1109/IWW-BCI.2018.8311487
Kang T, Chen Y, Fazli S, Wallraven C. Decoding of human memory formation with EEG signals using convolutional networks. In 2018 6th International Conference on Brain-Computer Interface, BCI 2018. Vol. 2018-January. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-5 https://doi.org/10.1109/IWW-BCI.2018.8311487
Kang, Taeho ; Chen, Yiyu ; Fazli, Siamac ; Wallraven, Christian. / Decoding of human memory formation with EEG signals using convolutional networks. 2018 6th International Conference on Brain-Computer Interface, BCI 2018. Vol. 2018-January Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1-5
@inproceedings{cd1fe1f192a246faab780f86e122282e,
title = "Decoding of human memory formation with EEG signals using convolutional networks",
abstract = "This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.",
author = "Taeho Kang and Yiyu Chen and Siamac Fazli and Christian Wallraven",
year = "2018",
month = "3",
day = "9",
doi = "10.1109/IWW-BCI.2018.8311487",
language = "English",
volume = "2018-January",
pages = "1--5",
booktitle = "2018 6th International Conference on Brain-Computer Interface, BCI 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Decoding of human memory formation with EEG signals using convolutional networks

AU - Kang, Taeho

AU - Chen, Yiyu

AU - Fazli, Siamac

AU - Wallraven, Christian

PY - 2018/3/9

Y1 - 2018/3/9

N2 - This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

AB - This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with memorizing German-Korean word association pairs, and their retention performance is tested on the day of and the day after learning. To investigate whether brain activity recorded via multi-channel EEG is predictive of memory formation, we perform statistical analysis followed by single-trial classification: First by using linear discriminant analysis, and then with convolutional neural networks. Our preliminary results confirm previous neurophysiological findings, that above-chance prediction of vocabulary memory formation is possible in both LDA and deep neural networks.

UR - http://www.scopus.com/inward/record.url?scp=85050809251&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050809251&partnerID=8YFLogxK

U2 - 10.1109/IWW-BCI.2018.8311487

DO - 10.1109/IWW-BCI.2018.8311487

M3 - Conference contribution

AN - SCOPUS:85050809251

VL - 2018-January

SP - 1

EP - 5

BT - 2018 6th International Conference on Brain-Computer Interface, BCI 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -