HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

Interaction multimodale en entrée : Conception et Prototypage

Marcos Serrano 1
1 IIHM - Ingénierie de l’Interaction Homme-Machine
LIG - Laboratoire d'Informatique de Grenoble
Abstract : In our work, we focus on the design of interactive systems. We are specifically interested in multimodal interactive systems that include several interaction modalities used by the user (input modalities) or by the system (output modalities) in an independent or combined way. Recent years have seen the advent of a variety of interaction modalities including multi-touch, two-handed and tangible interfaces: Multimodal interaction is no longer reduced to the combination of speech and gesture and we are facing a wide range of possibilities for multimodal interaction. In this context, our doctoral research is dedicated to conceptual and software tools for efficiently exploring the huge set of possibilities during the design phase of input multimodal interfaces. We present a component-based approach for designing and prototyping functional and/or simulated input multimodal interfaces. Our approach relies on the data-flow, from input devices to the user-tasks, depicted by an assembly of components. Our results are both conceptual and practical. Our conceptual model consists of a characterization space for describing components. This space helps interaction designers to define component assemblies and to consequently consider different design alternatives for input multimodality. Our software tool is a component-based prototyping tool that implements the characterization space (i.e., our conceptual model). We have implemented several multimodal prototypes using this tool, both functional and simulated by a human using a Wizard Of Oz approach. The developed multimodal prototypes involve a large variety of interaction modalities including 2D/3D gesture, 3D pointing technique, speech commands, head and body movements, geolocalization techniques as well as tangible techniques.
Document type :
Complete list of metadata

Cited literature [146 references]  Display  Hide  Download

Contributor : Marcos Serrano Connect in order to contact the contributor
Submitted on : Wednesday, July 2, 2014 - 12:16:17 PM
Last modification on : Friday, March 25, 2022 - 9:42:36 AM
Long-term archiving on: : Thursday, October 2, 2014 - 11:20:15 AM


  • HAL Id : tel-01017242, version 1



Marcos Serrano. Interaction multimodale en entrée : Conception et Prototypage. Interface homme-machine [cs.HC]. Université de Grenoble, 2010. Français. ⟨tel-01017242⟩



Record views


Files downloads