Evaluation of hand-foot coordinated quadruped interaction for mobile applications

Youngwon Kim, Euijai Ahn, Jeonghyun Kim

Research output: Contribution to journalArticle

Abstract

We evaluate the use of a foot-based input, coordinated with the hands/fingers, for the realization of fast (or simultaneous) multiple inputs for a hand-held device. We called the overall interaction technique the “quadruped user interface (QUI)” to reflect the main idea of making effective use of all four limbs of the human user. To investigate QUI’s utility, a foot-based interaction device was implemented by mounting a pressure sensor/switch in the sole of a shoe, acting upon a preset pressure threshold as a remote button device for the hand-held device. Experiments were conducted to assess the performance, usability and learnability of the proposed QUI on three representative mobile interactive tasks; namely, typing (e.g., for texting), object manipulation (e.g., for icon dragging), and making continuous control decisions (e.g., for game playing). Experimental results have shown that QUI generally did not exhibit the expected competent performance compared to the usual bimanual finger input, even with few days of practice. We highlight important considerations and lessons learned for interaction design with QUI, which one may consider as a viable future wearable interaction technique.

Original languageEnglish
Pages (from-to)1-11
Number of pages11
JournalJournal on Multimodal User Interfaces
DOIs
Publication statusAccepted/In press - 2017 Nov 16

Fingerprint

User interfaces
Pressure sensors
Mountings
Switches
Experiments

Keywords

  • Hand-foot coordination
  • Multimodal interaction
  • Task performance
  • Usability
  • Wearable interface

ASJC Scopus subject areas

  • Signal Processing
  • Human-Computer Interaction

Cite this

Evaluation of hand-foot coordinated quadruped interaction for mobile applications. / Kim, Youngwon; Ahn, Euijai; Kim, Jeonghyun.

In: Journal on Multimodal User Interfaces, 16.11.2017, p. 1-11.

Research output: Contribution to journalArticle

@article{ab15003da39a43b88410074884838955,
title = "Evaluation of hand-foot coordinated quadruped interaction for mobile applications",
abstract = "We evaluate the use of a foot-based input, coordinated with the hands/fingers, for the realization of fast (or simultaneous) multiple inputs for a hand-held device. We called the overall interaction technique the “quadruped user interface (QUI)” to reflect the main idea of making effective use of all four limbs of the human user. To investigate QUI’s utility, a foot-based interaction device was implemented by mounting a pressure sensor/switch in the sole of a shoe, acting upon a preset pressure threshold as a remote button device for the hand-held device. Experiments were conducted to assess the performance, usability and learnability of the proposed QUI on three representative mobile interactive tasks; namely, typing (e.g., for texting), object manipulation (e.g., for icon dragging), and making continuous control decisions (e.g., for game playing). Experimental results have shown that QUI generally did not exhibit the expected competent performance compared to the usual bimanual finger input, even with few days of practice. We highlight important considerations and lessons learned for interaction design with QUI, which one may consider as a viable future wearable interaction technique.",
keywords = "Hand-foot coordination, Multimodal interaction, Task performance, Usability, Wearable interface",
author = "Youngwon Kim and Euijai Ahn and Jeonghyun Kim",
year = "2017",
month = "11",
day = "16",
doi = "10.1007/s12193-017-0254-y",
language = "English",
pages = "1--11",
journal = "Journal on Multimodal User Interfaces",
issn = "1783-7677",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Evaluation of hand-foot coordinated quadruped interaction for mobile applications

AU - Kim, Youngwon

AU - Ahn, Euijai

AU - Kim, Jeonghyun

PY - 2017/11/16

Y1 - 2017/11/16

N2 - We evaluate the use of a foot-based input, coordinated with the hands/fingers, for the realization of fast (or simultaneous) multiple inputs for a hand-held device. We called the overall interaction technique the “quadruped user interface (QUI)” to reflect the main idea of making effective use of all four limbs of the human user. To investigate QUI’s utility, a foot-based interaction device was implemented by mounting a pressure sensor/switch in the sole of a shoe, acting upon a preset pressure threshold as a remote button device for the hand-held device. Experiments were conducted to assess the performance, usability and learnability of the proposed QUI on three representative mobile interactive tasks; namely, typing (e.g., for texting), object manipulation (e.g., for icon dragging), and making continuous control decisions (e.g., for game playing). Experimental results have shown that QUI generally did not exhibit the expected competent performance compared to the usual bimanual finger input, even with few days of practice. We highlight important considerations and lessons learned for interaction design with QUI, which one may consider as a viable future wearable interaction technique.

AB - We evaluate the use of a foot-based input, coordinated with the hands/fingers, for the realization of fast (or simultaneous) multiple inputs for a hand-held device. We called the overall interaction technique the “quadruped user interface (QUI)” to reflect the main idea of making effective use of all four limbs of the human user. To investigate QUI’s utility, a foot-based interaction device was implemented by mounting a pressure sensor/switch in the sole of a shoe, acting upon a preset pressure threshold as a remote button device for the hand-held device. Experiments were conducted to assess the performance, usability and learnability of the proposed QUI on three representative mobile interactive tasks; namely, typing (e.g., for texting), object manipulation (e.g., for icon dragging), and making continuous control decisions (e.g., for game playing). Experimental results have shown that QUI generally did not exhibit the expected competent performance compared to the usual bimanual finger input, even with few days of practice. We highlight important considerations and lessons learned for interaction design with QUI, which one may consider as a viable future wearable interaction technique.

KW - Hand-foot coordination

KW - Multimodal interaction

KW - Task performance

KW - Usability

KW - Wearable interface

UR - http://www.scopus.com/inward/record.url?scp=85034230574&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034230574&partnerID=8YFLogxK

U2 - 10.1007/s12193-017-0254-y

DO - 10.1007/s12193-017-0254-y

M3 - Article

SP - 1

EP - 11

JO - Journal on Multimodal User Interfaces

JF - Journal on Multimodal User Interfaces

SN - 1783-7677

ER -