Interaction multimodale en entrée : Conception et Prototypage

Marcos Serrano 1
1 LIG Laboratoire d'Informatique de Grenoble - IIHM
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : In our work, we focus on the design of interactive systems. We are specifically interested in multimodal interactive systems that include several interaction modalities used by the user (input modalities) or by the system (output modalities) in an independent or combined way. Recent years have seen the advent of a variety of interaction modalities including multi-touch, two-handed and tangible interfaces: Multimodal interaction is no longer reduced to the combination of speech and gesture and we are facing a wide range of possibilities for multimodal interaction. In this context, our doctoral research is dedicated to conceptual and software tools for efficiently exploring the huge set of possibilities during the design phase of input multimodal interfaces. We present a component-based approach for designing and prototyping functional and/or simulated input multimodal interfaces. Our approach relies on the data-flow, from input devices to the user-tasks, depicted by an assembly of components. Our results are both conceptual and practical. Our conceptual model consists of a characterization space for describing components. This space helps interaction designers to define component assemblies and to consequently consider different design alternatives for input multimodality. Our software tool is a component-based prototyping tool that implements the characterization space (i.e., our conceptual model). We have implemented several multimodal prototypes using this tool, both functional and simulated by a human using a Wizard Of Oz approach. The developed multimodal prototypes involve a large variety of interaction modalities including 2D/3D gesture, 3D pointing technique, speech commands, head and body movements, geolocalization techniques as well as tangible techniques.
Document type :
Theses
Complete list of metadatas

Cited literature [146 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01017242
Contributor : Marcos Serrano <>
Submitted on : Wednesday, July 2, 2014 - 12:16:17 PM
Last modification on : Thursday, October 11, 2018 - 8:48:03 AM
Long-term archiving on : Thursday, October 2, 2014 - 11:20:15 AM

Identifiers

  • HAL Id : tel-01017242, version 1

Collections

Citation

Marcos Serrano. Interaction multimodale en entrée : Conception et Prototypage. Interface homme-machine [cs.HC]. Université de Grenoble, 2010. Français. ⟨tel-01017242⟩

Share

Metrics

Record views

1093

Files downloads

1438