Skip to Main content Skip to Navigation

Ingénierie de l'interaction multimodale en entrée
Approche à composants ICARE

Abstract : The area of multimodal interaction has expanded rapidly since the seminal “Put that there” demonstrator
of R. Bolt that combines speech and gesture. In parallel with the development of the Graphical User
Interface technology, natural language processing and gesture recognition have made significant
progress. In addition, recent interaction paradigms such as tangible and embodied user interfaces as well
as augmented reality open a vast world of possibilities for interaction modalities. Significant achievements
have been made in terms of both modalities and real multimodal systems. Although several multimodal
systems have been built, their design and development still remains a difficult task particularly because
of a lack of reusability. In this thesis we address this problem of design and development for input
multimodal interfaces (from the user to the system). We describe a conceptual model of multimodality
as a unified framework for modalities and combinations of modalities. Based on this conceptual model,
we define a generic component-based approach called ICARE which allows the easy and rapid design,
development and maintenance of multimodal interfaces. We have developed the ICARE tool to prove
the usefulness of our component-based approach. The ICARE tool is a graphical platform that enables
the designer/developer to graphically manipulate and assemble ICARE software components in order
to specify the multimodal interaction. From this specification, the code of the multimodal interaction is
automatically generated. Five multimodal systems with different characteristics (augmented virtuality/
reality, mobile systems) have been developed with the ICARE tool.
Document type :
Complete list of metadata
Contributor : Jullien Bouchet <>
Submitted on : Saturday, June 16, 2007 - 8:57:20 AM
Last modification on : Friday, November 6, 2020 - 4:10:29 AM
Long-term archiving on: : Thursday, April 8, 2010 - 5:56:33 PM


  • HAL Id : tel-00155227, version 1




Jullien Bouchet. Ingénierie de l'interaction multimodale en entrée
Approche à composants ICARE. Interface homme-machine [cs.HC]. Université Joseph-Fourier - Grenoble I, 2006. Français. ⟨tel-00155227⟩



Record views


Files downloads