Abstract
Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.
| Original language | English |
|---|---|
| Journal | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| DOIs | |
| Publication status | Accepted/In press - 2017 Aug 11 |
Fingerprint
Keywords
- Brain-Computer Interface (BCI)
- Character recognition
- Color
- Electroencephalography
- Event-Related Potential (ERP)
- Gazeindependent
- Rapid Serial Visual Presentation (RSVP)
- Shape
- Target recognition
- Training
- Visualization
ASJC Scopus subject areas
- Neuroscience(all)
- Biomedical Engineering
- Computer Science Applications
Cite this
Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces. / Won, Dong Ok; Hwang, Han Jeong; Kim, Dong Min; Muller, Klaus; Lee, Seong Whan.
In: IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11.08.2017.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Motion-based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces
AU - Won, Dong Ok
AU - Hwang, Han Jeong
AU - Kim, Dong Min
AU - Muller, Klaus
AU - Lee, Seong Whan
PY - 2017/8/11
Y1 - 2017/8/11
N2 - Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.
AB - Most event-related potential (ERP)-based braincomputer interface (BCI) spellers primarily use matrix layouts, and generally require moderate eye movement for successful operation. The fundamental objective of this study is to enhance the perceptibility of target characters by introducing motion stimuli to classical rapid serial visual presentation (RSVP) spellers that do not require any eye movement, thereby applying them to paralyzed patients with oculomotor dysfunctions. To test the feasibility of the proposed motion-based RSVP paradigm, we implemented three RSVP spellers: i) fixed-direction motion (FM-RSVP), ii) random-direction motion (RM-RSVP), and iii) (the conventional) non-motion stimulation (NM-RSVP), and evaluated the effect of the three different stimulation methods on spelling performance. The two motion-based stimulation methods, FM- and RM-RSVP, showed shorter P300 latency and higher P300 amplitudes (i. e., 360.4-379.6 ms; 5.5867-5.7662 mV) than the NM-RSVP (i. e., 480.4 ms; 4.7426 mV). This led to higher and more stable performances for FM- and RMRSVP spellers than NM-RSVP speller (i. e., 79.06±6.45% for NM-RSVP, 90.60±2.98% for RM-RSVP, and 92.74±2.55% for FM-RSVP). In particular, the proposed motion-based RSVP paradigm was significantly beneficial for about half of the subjects who might not accurately perceive rapidly presented static stimuli. These results indicate that the use of proposed motion-based RSVP paradigm is more beneficial for target recognition when developing BCI applications for severely paralyzed patients with complex ocular dysfunctions.
KW - Brain-Computer Interface (BCI)
KW - Character recognition
KW - Color
KW - Electroencephalography
KW - Event-Related Potential (ERP)
KW - Gazeindependent
KW - Rapid Serial Visual Presentation (RSVP)
KW - Shape
KW - Target recognition
KW - Training
KW - Visualization
UR - http://www.scopus.com/inward/record.url?scp=85028411397&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85028411397&partnerID=8YFLogxK
U2 - 10.1109/TNSRE.2017.2736600
DO - 10.1109/TNSRE.2017.2736600
M3 - Article
JO - IEEE Transactions on Neural Systems and Rehabilitation Engineering
JF - IEEE Transactions on Neural Systems and Rehabilitation Engineering
SN - 1534-4320
ER -