MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Myunghee Lee; Jeonghyun Kim; Jeonghyun Baek

doi:10.1007/978-3-319-58697-7_12

MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications

Myunghee Lee, Jeonghyun Kim, Jeonghyun Baek

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

Original language	English
Title of host publication	Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings
Publisher	Springer Verlag
Pages	172-179
Number of pages	8
Volume	10291 LNCS
ISBN (Print)	9783319586960
DOIs	https://doi.org/10.1007/978-3-319-58697-7_12
Publication status	Published - 2017
Event	5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017 - Vancouver, Canada Duration: 2017 Jul 9 → 2017 Jul 14

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10291 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017
Country	Canada
City	Vancouver
Period	17/7/9 → 17/7/14

Fingerprint

Keywords

Cloud based interaction
Multimodal interaction
Software framework
Ubiquitous interaction

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Cite this

Lee, M., Kim, J., & Baek, J. (2017). MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. In Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings (Vol. 10291 LNCS, pp. 172-179). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10291 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58697-7_12

MIDAS-M : A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. / Lee, Myunghee; Kim, Jeonghyun; Baek, Jeonghyun.

Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. Vol. 10291 LNCS Springer Verlag, 2017. p. 172-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10291 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lee, M, Kim, J & Baek, J 2017, MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. in Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. vol. 10291 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10291 LNCS, Springer Verlag, pp. 172-179, 5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017, Vancouver, Canada, 17/7/9. https://doi.org/10.1007/978-3-319-58697-7_12

Lee M, Kim J, Baek J. MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. In Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. Vol. 10291 LNCS. Springer Verlag. 2017. p. 172-179. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-58697-7_12

Lee, Myunghee ; Kim, Jeonghyun ; Baek, Jeonghyun. / MIDAS-M : A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications. Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings. Vol. 10291 LNCS Springer Verlag, 2017. pp. 172-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{220dd5924328492a80130cdb0322aa17,

title = "MIDAS-M: A software framework for supporting multimodal interaction on heterogeneous interaction devices for cloud applications",

abstract = "In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.",

keywords = "Cloud based interaction, Multimodal interaction, Software framework, Ubiquitous interaction",

author = "Myunghee Lee and Jeonghyun Kim and Jeonghyun Baek",

year = "2017",

doi = "10.1007/978-3-319-58697-7_12",

language = "English",

isbn = "9783319586960",

volume = "10291 LNCS",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "172--179",

booktitle = "Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings",

note = "5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017 ; Conference date: 09-07-2017 Through 14-07-2017",

}

TY - GEN

T1 - MIDAS-M

T2 - 5th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2017, held as part of the 19th International Conference on Human-Computer Interaction, HCI 2017

AU - Lee, Myunghee

AU - Kim, Jeonghyun

AU - Baek, Jeonghyun

PY - 2017

Y1 - 2017

N2 - In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

AB - In this paper, we present a software framework, called MIDAS-M (Mixing and matching heterogeneous Interaction Devices to Applications and Services) that enables an application to lend itself to many different types of interaction methods and accommodate users with different client devices in a flexible manner. In particular, we focus on the aspect of supporting “multimodal” interaction by defining and mapping events that are mixed and matched by different input/output components. The multimodal events defined this way can be realized on various client platforms according to their capabilities. We also describe a case study of applying MIDAS-M to developing a multimodal interface for a virtual apartment preview system, called the SMARTIS, and demonstrate its advantages.

KW - Cloud based interaction

KW - Multimodal interaction

KW - Software framework

KW - Ubiquitous interaction

UR - http://www.scopus.com/inward/record.url?scp=85025144033&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85025144033&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-58697-7_12

DO - 10.1007/978-3-319-58697-7_12

M3 - Conference contribution

AN - SCOPUS:85025144033

SN - 9783319586960

VL - 10291 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 172

EP - 179

BT - Distributed, Ambient and Pervasive Interactions - 5th International Conference, DAPI 2017 Held as Part of HCI International 2017, Proceedings

PB - Springer Verlag

Y2 - 9 July 2017 through 14 July 2017

ER -

Access to Document

10.1007/978-3-319-58697-7_12