MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Myunghee Lee; Gerard J. Kim; Jeonghyun Baek

doi:10.1007/978-3-319-58697-7_12

MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Myunghee Lee, Gerard J. Kim, Jeonghyun Baek

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

Original language	English
Title of host publication	Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings
Editors	Norbert Streitz, Panos Markopoulos
Publisher	Springer Verlag
Pages	172-179
Number of pages	8
ISBN (Print)	9783319586960
DOIs	https://doi.org/10.1007/978-3-319-58697-7_12
Publication status	Published - 2017
Event	5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017 - Vancouver, Canada Duration: 2017 Jul 9 → 2017 Jul 14

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10291 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017
Country/Territory	Canada
City	Vancouver
Period	17/7/9 → 17/7/14

Keywords

Cloud based interaction
Multimodal interaction
Software framework
Ubiquitous interaction

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-319-58697-7_12

Cite this

Lee, M., Kim, G. J., & Baek, J. (2017). MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. In N. Streitz, & P. Markopoulos (Eds.), Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings (pp. 172-179). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10291 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58697-7_12

MIDAS-M : A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. / Lee, Myunghee; Kim, Gerard J.; Baek, Jeonghyun.

Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. ed. / Norbert Streitz; Panos Markopoulos. Springer Verlag, 2017. p. 172-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10291 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, M, Kim, GJ & Baek, J 2017, MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. in N Streitz & P Markopoulos (eds), Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10291 LNCS, Springer Verlag, pp. 172-179, 5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017, Vancouver, Canada, 17/7/9. https://doi.org/10.1007/978-3-319-58697-7_12

Lee M, Kim GJ, Baek J. MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. In Streitz N, Markopoulos P, editors, Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. Springer Verlag. 2017. p. 172-179. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-58697-7_12

Lee, Myunghee ; Kim, Gerard J. ; Baek, Jeonghyun. / MIDAS-M : A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. editor / Norbert Streitz ; Panos Markopoulos. Springer Verlag, 2017. pp. 172-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{220dd5924328492a80130cdb0322aa17,

title = "MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications",

abstract = "In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.",

keywords = "Cloud based interaction, Multimodal interaction, Software framework, Ubiquitous interaction",

author = "Myunghee Lee and Kim, {Gerard J.} and Jeonghyun Baek",

note = "Funding Information: The research was supported through the “Software Convergence Technology Development Program,” funded by the Ministry of Science, ICT and Future Planning (S1002-13-1005), and also through the “Basic Science Research Program,” funded by the Korean National Research Foundation (No. 2011-0030079). Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017 ; Conference date: 09-07-2017 Through 14-07-2017",

year = "2017",

doi = "10.1007/978-3-319-58697-7_12",

language = "English",

isbn = "9783319586960",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "172--179",

editor = "Norbert Streitz and Panos Markopoulos",

booktitle = "Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings",

}

TY - GEN

T1 - MIDAS-M

T2 - 5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017

AU - Lee, Myunghee

AU - Kim, Gerard J.

AU - Baek, Jeonghyun

N1 - Funding Information: The research was supported through the “Software Convergence Technology Development Program,” funded by the Ministry of Science, ICT and Future Planning (S1002-13-1005), and also through the “Basic Science Research Program,” funded by the Korean National Research Foundation (No. 2011-0030079). Publisher Copyright: © Springer International Publishing AG 2017.

PY - 2017

Y1 - 2017

N2 - In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

AB - In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

KW - Cloud based interaction

KW - Multimodal interaction

KW - Software framework

KW - Ubiquitous interaction

UR - http://www.scopus.com/inward/record.url?scp=85025144033&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-58697-7_12

DO - 10.1007/978-3-319-58697-7_12

M3 - Conference contribution

AN - SCOPUS:85025144033

SN - 9783319586960

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 172

EP - 179

BT - Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings

A2 - Streitz, Norbert

A2 - Markopoulos, Panos

PB - Springer Verlag

Y2 - 9 July 2017 through 14 July 2017

ER -

MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this