Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces

Dong Ok Won, Han Jeong Hwang, Dong Min Kim, Klaus Muller, Seong Whan Lee

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.

Original languageEnglish
JournalIEEE Transactions on Neural Systems and Rehabilitation Engineering
DOIs
Publication statusAccepted/In press - 2017 Aug 11

Fingerprint

Brain-Computer Interfaces
Brain computer interface
Eye movements
Eye Movements
Evoked Potentials

Keywords

  • Brain-Computer Interface (BCI)
  • Character recognition
  • Color
  • Electroencephalography
  • Event-Related Potential (ERP)
  • Gazeindependent
  • Rapid Serial Visual Presentation (RSVP)
  • Shape
  • Target recognition
  • Training
  • Visualization

ASJC Scopus subject areas

  • Neuroscience(all)
  • Biomedical Engineering
  • Computer Science Applications

Cite this

Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces. / Won, Dong Ok; Hwang, Han Jeong; Kim, Dong Min; Muller, Klaus; Lee, Seong Whan.

In: IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11.08.2017.

Research output: Contribution to journalArticle

@article{3c1b2d17d460418c8f658d58f4c209f9,
title = "Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces",
abstract = "Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45{\%} for NM-RSVP, 90.60±2.98{\%} for RM-RSVP, and 92.74±2.55{\%} for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.",
keywords = "Brain-Computer Interface (BCI), Character recognition, Color, Electroencephalography, Event-Related Potential (ERP), Gazeindependent, Rapid Serial Visual Presentation (RSVP), Shape, Target recognition, Training, Visualization",
author = "Won, {Dong Ok} and Hwang, {Han Jeong} and Kim, {Dong Min} and Klaus Muller and Lee, {Seong Whan}",
year = "2017",
month = "8",
day = "11",
doi = "10.1109/TNSRE.2017.2736600",
language = "English",
journal = "IEEE Transactions on Neural Systems and Rehabilitation Engineering",
issn = "1534-4320",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces

AU - Won, Dong Ok

AU - Hwang, Han Jeong

AU - Kim, Dong Min

AU - Muller, Klaus

AU - Lee, Seong Whan

PY - 2017/8/11

Y1 - 2017/8/11

N2 - Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.

AB - Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.

KW - Brain-Computer Interface (BCI)

KW - Character recognition

KW - Color

KW - Electroencephalography

KW - Event-Related Potential (ERP)

KW - Gazeindependent

KW - Rapid Serial Visual Presentation (RSVP)

KW - Shape

KW - Target recognition

KW - Training

KW - Visualization

UR - http://www.scopus.com/inward/record.url?scp=85028411397&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028411397&partnerID=8YFLogxK

U2 - 10.1109/TNSRE.2017.2736600

DO - 10.1109/TNSRE.2017.2736600

M3 - Article

JO - IEEE Transactions on Neural Systems and Rehabilitation Engineering

JF - IEEE Transactions on Neural Systems and Rehabilitation Engineering

SN - 1534-4320

ER -