Vouch-T: Multimodal text input for mobile devices using voice and touch

Minyoung Lee; Gerard J. Kim

doi:10.1007/978-3-319-58077-7_17

Vouch-T: Multimodal text input for mobile devices using voice and touch

Minyoung Lee, Gerard J. Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

Original language	English
Title of host publication	Human–Computer Interaction
Subtitle of host publication	Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings
Editors	Masaaki Kurosu
Publisher	Springer Verlag
Pages	208-224
Number of pages	17
ISBN (Print)	9783319580760
DOIs	https://doi.org/10.1007/978-3-319-58077-7_17
Publication status	Published - 2017
Event	19th International Conference on Human–Computer Interaction, HCI International 2017 - Vancouver, Canada Duration: 2017 Jul 9 → 2017 Jul 14

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10272 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	19th International Conference on Human–Computer Interaction, HCI International 2017
Country/Territory	Canada
City	Vancouver
Period	17/7/9 → 17/7/14

Keywords

Keyboard
Multimodal input
Smart phone
Smart watch
Task performance
Text input
Usability
Voice

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-319-58077-7_17

Cite this

Lee, M., & Kim, G. J. (2017). Vouch-T: Multimodal text input for mobile devices using voice and touch. In M. Kurosu (Ed.), Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings (pp. 208-224). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10272 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58077-7_17

Vouch-T : Multimodal text input for mobile devices using voice and touch. / Lee, Minyoung; Kim, Gerard J.

Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. ed. / Masaaki Kurosu. Springer Verlag, 2017. p. 208-224 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10272 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, M & Kim, GJ 2017, Vouch-T: Multimodal text input for mobile devices using voice and touch. in M Kurosu (ed.), Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10272 LNCS, Springer Verlag, pp. 208-224, 19th International Conference on Human–Computer Interaction, HCI International 2017, Vancouver, Canada, 17/7/9. https://doi.org/10.1007/978-3-319-58077-7_17

Lee M, Kim GJ. Vouch-T: Multimodal text input for mobile devices using voice and touch. In Kurosu M, editor, Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. Springer Verlag. 2017. p. 208-224. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-58077-7_17

Lee, Minyoung ; Kim, Gerard J. / Vouch-T : Multimodal text input for mobile devices using voice and touch. Human–Computer Interaction: Interaction Contexts - 19th International Conference, HCI International 2017, Proceedings. editor / Masaaki Kurosu. Springer Verlag, 2017. pp. 208-224 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{8a76abe1b61f473eb8caa3b50649e9bf,

title = "Vouch-T: Multimodal text input for mobile devices using voice and touch",

abstract = "Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.",

keywords = "Keyboard, Multimodal input, Smart phone, Smart watch, Task performance, Text input, Usability, Voice",

author = "Minyoung Lee and Kim, {Gerard J.}",

note = "Funding Information: This work was supported by the Technology Innovation Program (or Industrial Strategic Technology Development Program (10053638, International technology standardization of 3D data information, and industrialization) funded By the Ministry of Trade, Industry & Energy (MOTIE, Korea) and also by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (No. 2011-0030079). Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 19th International Conference on Human–Computer Interaction, HCI International 2017 ; Conference date: 09-07-2017 Through 14-07-2017",

year = "2017",

doi = "10.1007/978-3-319-58077-7_17",

language = "English",

isbn = "9783319580760",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "208--224",

editor = "Masaaki Kurosu",

booktitle = "Human–Computer Interaction",

}

TY - GEN

T1 - Vouch-T

T2 - 19th International Conference on Human–Computer Interaction, HCI International 2017

AU - Lee, Minyoung

AU - Kim, Gerard J.

N1 - Funding Information: This work was supported by the Technology Innovation Program (or Industrial Strategic Technology Development Program (10053638, International technology standardization of 3D data information, and industrialization) funded By the Ministry of Trade, Industry & Energy (MOTIE, Korea) and also by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (No. 2011-0030079). Publisher Copyright: © Springer International Publishing AG 2017.

PY - 2017

Y1 - 2017

N2 - Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

AB - Entering text on a small mobile device is not easy due to the relatively small screen space and the fat finger problem. We consider a multimodal text input method, called Vouch-T (Voice + tOUCH - Text) combining the touch and voice input in complementary way. With Vouch-T, the user makes an approximate touch among densely distributed alphabetic keys, accompanied with the voice input to effectively disambiguate the target among possible candidates. We have assessed the potential of Vouch-T in terms of the usability and performance compared to the conventional touch-only based method. We considered two types of text input layout, namely, the QWERTY and 3 × 4 telephone keypad on two sizes of mobile devices, the smart phone and smart watch. The comparative simulation experiment validated that the multimodal approach of Vouch-T improves the input performance and usability for the smaller-sized smart watch, but only marginally for the larger smart phone.

KW - Keyboard

KW - Multimodal input

KW - Smart phone

KW - Smart watch

KW - Task performance

KW - Text input

KW - Usability

KW - Voice

UR - http://www.scopus.com/inward/record.url?scp=85025122802&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-58077-7_17

DO - 10.1007/978-3-319-58077-7_17

M3 - Conference contribution

AN - SCOPUS:85025122802

SN - 9783319580760

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 208

EP - 224

BT - Human–Computer Interaction

A2 - Kurosu, Masaaki

PB - Springer Verlag

Y2 - 9 July 2017 through 14 July 2017

ER -

Vouch-T: Multimodal text input for mobile devices using voice and touch

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this