Vouch-T: Multimodal text input for mobile devices using voice and touch

Minyoung Lee, Jeonghyun Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

Original languageEnglish
Title of host publicationHuman–Computer Interaction
Subtitle of host publicationInteraction Contexts - 19th International Conference, HCI International 2017, Proceedings
PublisherSpringer Verlag
Pages208-224
Number of pages17
Volume10272 LNCS
ISBN (Print)9783319580760
DOIs
Publication statusPublished - 2017
Event19th International Conference on Human–Computer Interaction, HCI International 2017 - Vancouver, Canada
Duration: 2017 Jul 92017 Jul 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10272 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other19th International Conference on Human–Computer Interaction, HCI International 2017
CountryCanada
CityVancouver
Period17/7/917/7/14

Fingerprint

Mobile devices
Mobile Devices
Watches
Speech recognition
Computer keyboards
Usability
Oils and fats
Telephone
Text
Voice
Simulation Experiment
Layout
Experiments
Target

Keywords

  • Keyboard
  • Multimodal input
  • Smart phone
  • Smart watch
  • Task performance
  • Text input
  • Usability
  • Voice

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Lee, M., & Kim, J. (2017). Vouch-T: Multimodal text input for mobile devices using voice and touch. In Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings (Vol. 10272 LNCS, pp. 208-224). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10272 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58077-7_17

Vouch-T : Multimodal text input for mobile devices using voice and touch. / Lee, Minyoung; Kim, Jeonghyun.

Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. Vol. 10272 LNCS Springer Verlag, 2017. p. 208-224 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10272 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, M & Kim, J 2017, Vouch-T: Multimodal text input for mobile devices using voice and touch. in Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. vol. 10272 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10272 LNCS, Springer Verlag, pp. 208-224, 19th International Conference on Human–Computer Interaction, HCI International 2017, Vancouver, Canada, 17/7/9. https://doi.org/10.1007/978-3-319-58077-7_17
Lee M, Kim J. Vouch-T: Multimodal text input for mobile devices using voice and touch. In Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. Vol. 10272 LNCS. Springer Verlag. 2017. p. 208-224. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-58077-7_17
Lee, Minyoung ; Kim, Jeonghyun. / Vouch-T : Multimodal text input for mobile devices using voice and touch. Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. Vol. 10272 LNCS Springer Verlag, 2017. pp. 208-224 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{8a76abe1b61f473eb8caa3b50649e9bf,
title = "Vouch-T: Multimodal text input for mobile devices using voice and touch",
abstract = "Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.",
keywords = "Keyboard, Multimodal input, Smart phone, Smart watch, Task performance, Text input, Usability, Voice",
author = "Minyoung Lee and Jeonghyun Kim",
year = "2017",
doi = "10.1007/978-3-319-58077-7_17",
language = "English",
isbn = "9783319580760",
volume = "10272 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "208--224",
booktitle = "Human–Computer Interaction",

}

TY - GEN

T1 - Vouch-T

T2 - Multimodal text input for mobile devices using voice and touch

AU - Lee, Minyoung

AU - Kim, Jeonghyun

PY - 2017

Y1 - 2017

N2 - Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

AB - Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

KW - Keyboard

KW - Multimodal input

KW - Smart phone

KW - Smart watch

KW - Task performance

KW - Text input

KW - Usability

KW - Voice

UR - http://www.scopus.com/inward/record.url?scp=85025122802&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85025122802&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-58077-7_17

DO - 10.1007/978-3-319-58077-7_17

M3 - Conference contribution

AN - SCOPUS:85025122802

SN - 9783319580760

VL - 10272 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 208

EP - 224

BT - Human–Computer Interaction

PB - Springer Verlag

ER -