Gaze-directed hands-free interface for mobile interaction

Gie Seo Park, Jong Gil Ahn, Gerard J. Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one's hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.

Original languageEnglish
Title of host publicationHuman-Computer Interaction
Subtitle of host publicationInteraction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings
Number of pages10
EditionPART 2
Publication statusPublished - 2011
Event14th International Conference on Human-Computer Interaction, HCI International 2011 - Orlando, FL, United States
Duration: 2011 Jul 92011 Jul 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume6762 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other14th International Conference on Human-Computer Interaction, HCI International 2011
Country/TerritoryUnited States
CityOrlando, FL


  • Gaze
  • Hands-free
  • Head-controlled
  • Mobile interface
  • Non-visual interface

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Gaze-directed hands-free interface for mobile interaction'. Together they form a unique fingerprint.

Cite this