Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces

J. Williamson, R. Murray-Smith, B. Blankertz, M. Krauledat, Klaus Muller

Research output: Contribution to journalArticle

56 Citations (Scopus)

Abstract

Designing user interfaces which can cope with unconventional control properties is challenging, and conventional interface design techniques are of little help. This paper examines how interactions can be designed to explicitly take into account the uncertainty and dynamics of control inputs. In particular, the asymmetry of feedback and control channels is highlighted as a key design constraint, which is especially obvious in current non-invasive brain-computer interfaces (BCIs). Brain-computer interfaces are systems capable of decoding neural activity in real time, thereby allowing a computer application to be directly controlled by thought. BCIs, however, have totally different signal properties than most conventional interaction devices. Bandwidth is very limited and there are comparatively long and unpredictable delays. Such interfaces cannot simply be treated as unwieldy mice. In this respect they are an example of a growing field of sensor-based interfaces which have unorthodox control properties. As a concrete example, we present the text entry application "Hex-O-Spell", controlled via motor-imagery based electroencephalography (EEG). The system utilizes the high visual display bandwidth to help compensate for the limited control signals, where the timing of the state changes encodes most of the information. We present results showing the comparatively high performance of this interface, with entry rates exceeding seven characters per minute.

Original languageEnglish
Pages (from-to)827-841
Number of pages15
JournalInternational Journal of Human Computer Studies
Volume67
Issue number10
DOIs
Publication statusPublished - 2009 Oct 1
Externally publishedYes

Fingerprint

Brain computer interface
brain
interaction
Bandwidth
Computer applications
Electroencephalography
user interface
asymmetry
User interfaces
Decoding
Display devices
uncertainty
Feedback
Sensors
performance

Keywords

  • Brain-computer interaction
  • EEG
  • Text entry

ASJC Scopus subject areas

  • Hardware and Architecture
  • Engineering(all)
  • Software
  • Human-Computer Interaction
  • Human Factors and Ergonomics
  • Education

Cite this

Designing for uncertain, asymmetric control : Interaction design for brain-computer interfaces. / Williamson, J.; Murray-Smith, R.; Blankertz, B.; Krauledat, M.; Muller, Klaus.

In: International Journal of Human Computer Studies, Vol. 67, No. 10, 01.10.2009, p. 827-841.

Research output: Contribution to journalArticle

Williamson, J. ; Murray-Smith, R. ; Blankertz, B. ; Krauledat, M. ; Muller, Klaus. / Designing for uncertain, asymmetric control : Interaction design for brain-computer interfaces. In: International Journal of Human Computer Studies. 2009 ; Vol. 67, No. 10. pp. 827-841.
@article{60b6df6339dc4d6c89e58a732710fcc3,
title = "Designing for uncertain, asymmetric control: Interaction design for brain-computer interfaces",
abstract = "Designing user interfaces which can cope with unconventional control properties is challenging, and conventional interface design techniques are of little help. This paper examines how interactions can be designed to explicitly take into account the uncertainty and dynamics of control inputs. In particular, the asymmetry of feedback and control channels is highlighted as a key design constraint, which is especially obvious in current non-invasive brain-computer interfaces (BCIs). Brain-computer interfaces are systems capable of decoding neural activity in real time, thereby allowing a computer application to be directly controlled by thought. BCIs, however, have totally different signal properties than most conventional interaction devices. Bandwidth is very limited and there are comparatively long and unpredictable delays. Such interfaces cannot simply be treated as unwieldy mice. In this respect they are an example of a growing field of sensor-based interfaces which have unorthodox control properties. As a concrete example, we present the text entry application {"}Hex-O-Spell{"}, controlled via motor-imagery based electroencephalography (EEG). The system utilizes the high visual display bandwidth to help compensate for the limited control signals, where the timing of the state changes encodes most of the information. We present results showing the comparatively high performance of this interface, with entry rates exceeding seven characters per minute.",
keywords = "Brain-computer interaction, EEG, Text entry",
author = "J. Williamson and R. Murray-Smith and B. Blankertz and M. Krauledat and Klaus Muller",
year = "2009",
month = "10",
day = "1",
doi = "10.1016/j.ijhcs.2009.05.009",
language = "English",
volume = "67",
pages = "827--841",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",
publisher = "Academic Press Inc.",
number = "10",

}

TY - JOUR

T1 - Designing for uncertain, asymmetric control

T2 - Interaction design for brain-computer interfaces

AU - Williamson, J.

AU - Murray-Smith, R.

AU - Blankertz, B.

AU - Krauledat, M.

AU - Muller, Klaus

PY - 2009/10/1

Y1 - 2009/10/1

N2 - Designing user interfaces which can cope with unconventional control properties is challenging, and conventional interface design techniques are of little help. This paper examines how interactions can be designed to explicitly take into account the uncertainty and dynamics of control inputs. In particular, the asymmetry of feedback and control channels is highlighted as a key design constraint, which is especially obvious in current non-invasive brain-computer interfaces (BCIs). Brain-computer interfaces are systems capable of decoding neural activity in real time, thereby allowing a computer application to be directly controlled by thought. BCIs, however, have totally different signal properties than most conventional interaction devices. Bandwidth is very limited and there are comparatively long and unpredictable delays. Such interfaces cannot simply be treated as unwieldy mice. In this respect they are an example of a growing field of sensor-based interfaces which have unorthodox control properties. As a concrete example, we present the text entry application "Hex-O-Spell", controlled via motor-imagery based electroencephalography (EEG). The system utilizes the high visual display bandwidth to help compensate for the limited control signals, where the timing of the state changes encodes most of the information. We present results showing the comparatively high performance of this interface, with entry rates exceeding seven characters per minute.

AB - Designing user interfaces which can cope with unconventional control properties is challenging, and conventional interface design techniques are of little help. This paper examines how interactions can be designed to explicitly take into account the uncertainty and dynamics of control inputs. In particular, the asymmetry of feedback and control channels is highlighted as a key design constraint, which is especially obvious in current non-invasive brain-computer interfaces (BCIs). Brain-computer interfaces are systems capable of decoding neural activity in real time, thereby allowing a computer application to be directly controlled by thought. BCIs, however, have totally different signal properties than most conventional interaction devices. Bandwidth is very limited and there are comparatively long and unpredictable delays. Such interfaces cannot simply be treated as unwieldy mice. In this respect they are an example of a growing field of sensor-based interfaces which have unorthodox control properties. As a concrete example, we present the text entry application "Hex-O-Spell", controlled via motor-imagery based electroencephalography (EEG). The system utilizes the high visual display bandwidth to help compensate for the limited control signals, where the timing of the state changes encodes most of the information. We present results showing the comparatively high performance of this interface, with entry rates exceeding seven characters per minute.

KW - Brain-computer interaction

KW - EEG

KW - Text entry

UR - http://www.scopus.com/inward/record.url?scp=69949094187&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69949094187&partnerID=8YFLogxK

U2 - 10.1016/j.ijhcs.2009.05.009

DO - 10.1016/j.ijhcs.2009.05.009

M3 - Article

AN - SCOPUS:69949094187

VL - 67

SP - 827

EP - 841

JO - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

IS - 10

ER -