Using keyboards with head mounted displays

Sooyoung Kim, Jeonghyun Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

Alphanumeric input is often required in many computer applications. Virtual reality (VR) applications are no exception. For instance, enabling the alphanumeric input can augment a typical VR based walkthrough system so that the user can make notes and annotations. However, methods for efficient alphanumeric input for HMD-based VR systems have only been treated in a limited way. A most typical approach is to use a virtual keyboard so that the users can leverage upon one's typing skill. However, such an approach requires intricate and difficult finger tracking and poses usability problems. Thus, we propose to use a real keyboard as a tangible interface to the virtual keyboard and provide natural haptic/tactile feedback. Instead of tracking the fingers with cumbersome devices, this paper demonstrates that finger positions can be approximated at sufficient accuracy for the typing task by only tracking the two hands. The concept of continuous calibration is introduced to compensate for the dynamically changing errors from the tracking devices, sensor positions, keyboard positions and assumed default hand sizes. The proposed alphanumeric input system is empirically compared to that of the real through an experiment, and the results show that users can indeed obtain near-real performance out of such a system.

Original languageEnglish
Title of host publicationProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry
Pages336-343
Number of pages8
Publication statusPublished - 2004 Dec 17
Externally publishedYes
EventProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry - , Singapore
Duration: 2004 Jun 162004 Jun 18

Other

OtherProceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry
CountrySingapore
Period04/6/1604/6/18

Fingerprint

Virtual reality
Display devices
Helmet mounted displays
Computer applications
Calibration
Feedback
Sensors
Experiments

Keywords

  • Alphanumeric input
  • Calibration
  • Head mounted display
  • Tangible interaction

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Kim, S., & Kim, J. (2004). Using keyboards with head mounted displays. In Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (pp. 336-343)

Using keyboards with head mounted displays. / Kim, Sooyoung; Kim, Jeonghyun.

Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. p. 336-343.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, S & Kim, J 2004, Using keyboards with head mounted displays. in Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. pp. 336-343, Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry, Singapore, 04/6/16.
Kim S, Kim J. Using keyboards with head mounted displays. In Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. p. 336-343
Kim, Sooyoung ; Kim, Jeonghyun. / Using keyboards with head mounted displays. Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry. 2004. pp. 336-343
@inproceedings{a1b4694529284a4e9e6490fcd316d3ed,
title = "Using keyboards with head mounted displays",
abstract = "Alphanumeric input is often required in many computer applications. Virtual reality (VR) applications are no exception. For instance, enabling the alphanumeric input can augment a typical VR based walkthrough system so that the user can make notes and annotations. However, methods for efficient alphanumeric input for HMD-based VR systems have only been treated in a limited way. A most typical approach is to use a virtual keyboard so that the users can leverage upon one's typing skill. However, such an approach requires intricate and difficult finger tracking and poses usability problems. Thus, we propose to use a real keyboard as a tangible interface to the virtual keyboard and provide natural haptic/tactile feedback. Instead of tracking the fingers with cumbersome devices, this paper demonstrates that finger positions can be approximated at sufficient accuracy for the typing task by only tracking the two hands. The concept of continuous calibration is introduced to compensate for the dynamically changing errors from the tracking devices, sensor positions, keyboard positions and assumed default hand sizes. The proposed alphanumeric input system is empirically compared to that of the real through an experiment, and the results show that users can indeed obtain near-real performance out of such a system.",
keywords = "Alphanumeric input, Calibration, Head mounted display, Tangible interaction",
author = "Sooyoung Kim and Jeonghyun Kim",
year = "2004",
month = "12",
day = "17",
language = "English",
isbn = "1581138849",
pages = "336--343",
booktitle = "Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry",

}

TY - GEN

T1 - Using keyboards with head mounted displays

AU - Kim, Sooyoung

AU - Kim, Jeonghyun

PY - 2004/12/17

Y1 - 2004/12/17

N2 - Alphanumeric input is often required in many computer applications. Virtual reality (VR) applications are no exception. For instance, enabling the alphanumeric input can augment a typical VR based walkthrough system so that the user can make notes and annotations. However, methods for efficient alphanumeric input for HMD-based VR systems have only been treated in a limited way. A most typical approach is to use a virtual keyboard so that the users can leverage upon one's typing skill. However, such an approach requires intricate and difficult finger tracking and poses usability problems. Thus, we propose to use a real keyboard as a tangible interface to the virtual keyboard and provide natural haptic/tactile feedback. Instead of tracking the fingers with cumbersome devices, this paper demonstrates that finger positions can be approximated at sufficient accuracy for the typing task by only tracking the two hands. The concept of continuous calibration is introduced to compensate for the dynamically changing errors from the tracking devices, sensor positions, keyboard positions and assumed default hand sizes. The proposed alphanumeric input system is empirically compared to that of the real through an experiment, and the results show that users can indeed obtain near-real performance out of such a system.

AB - Alphanumeric input is often required in many computer applications. Virtual reality (VR) applications are no exception. For instance, enabling the alphanumeric input can augment a typical VR based walkthrough system so that the user can make notes and annotations. However, methods for efficient alphanumeric input for HMD-based VR systems have only been treated in a limited way. A most typical approach is to use a virtual keyboard so that the users can leverage upon one's typing skill. However, such an approach requires intricate and difficult finger tracking and poses usability problems. Thus, we propose to use a real keyboard as a tangible interface to the virtual keyboard and provide natural haptic/tactile feedback. Instead of tracking the fingers with cumbersome devices, this paper demonstrates that finger positions can be approximated at sufficient accuracy for the typing task by only tracking the two hands. The concept of continuous calibration is introduced to compensate for the dynamically changing errors from the tracking devices, sensor positions, keyboard positions and assumed default hand sizes. The proposed alphanumeric input system is empirically compared to that of the real through an experiment, and the results show that users can indeed obtain near-real performance out of such a system.

KW - Alphanumeric input

KW - Calibration

KW - Head mounted display

KW - Tangible interaction

UR - http://www.scopus.com/inward/record.url?scp=10044254486&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10044254486&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:10044254486

SN - 1581138849

SP - 336

EP - 343

BT - Proceedings VRCAI 2004 - ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry

ER -