, L'évaluation d'un outil logiciel peut prendre plusieurs formes Une première approche consiste à mener des évaluations empiriques contrôlées Une autre forme d'évaluation consiste à montrer la variété des prototypes multimodaux possibles avec l'outil. La partie dédiée à l'évaluation empirique est divisée en deux sections. À la section 8.1 nous présentons une évaluation contrôlée de l'outil qui focalise sur la définition de prototypes interactifs tandis qu'à la section 8.2 nous détaillons une évaluation empirique de l'outil pour la conception de prototypes simulés
, A three-dimensional characterization space of software components for rapidly developing multimodal interfaces, Proceedings of the 10th international conference on Multimodal interfaces, IMCI '08, pp.149-156, 2008.
DOI : 10.1145/1452392.1452421
, Multimodal slideshow, Proceedings of the 10th international conference on Multimodal interfaces, IMCI '08, 2008.
DOI : 10.1145/1452392.1452430
, A wizard of oz component-based approach for rapidly prototyping and testing input multimodal interfaces, Journal on Multimodal User Interface, 2010.
, Multimodal signal processing and interaction for a driving simulator: Component-based architecture, Journal on Multimodal User Interface, 2007.
DOI : 10.1007/BF02884432
, OpenWizard : Une approche pour la création et l'évaluation rapide de prototypes multimodaux, proc. IHM'09, 21ème Conférence Francophone sur l'Interaction Homme-Machine, pp.101-109, 2009.
, OIDE, Proceedings of the 4th French-speaking conference on Mobility and buiquity computing , UbiMob '08, pp.91-92, 2008.
DOI : 10.1145/1376971.1376993
, Software Engineering for Multimodal Interactive Systems, Multimodal user interfaces : from signals to interaction, 2008.
, The OpenInterface framework : a tool for multimodal interaction In Extended Abstracts of CHI, pp.3501-3506, 2008.
, A Demonstration of the OpenInterface Interaction Development Environment, Adjunct Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, pp.39-40, 2007.
, Multimodal Signal Processing and Interaction for a Driving Simulator : Component-based semaines organisé dans le cadre d'eN- TERFACE, Rapport sur le projet Multimodal Driving Simulator, 2006.
, The new Oxford American dictionary, 2001.
, Maintaining knowledge about temporal intervals, Commun. ACM, vol.26, issue.11, pp.832-843, 1983.
, FlowStates, Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine, IHM '09, pp.119-128, 2009.
DOI : 10.1145/1629826.1629845
URL : https://hal.archives-ouvertes.fr/inria-00538598
, 2M, Proceedings of the 2nd French-speaking conference on Mobility and uibquity computing , UbiMob '05, 2005.
DOI : 10.1145/1102613.1102649
URL : https://hal.archives-ouvertes.fr/hal-00307005
, Sweep and point and shoot, CHI '05 extended abstracts on Human factors in computing systems , CHI '05, pp.1200-1203, 2005.
DOI : 10.1145/1056808.1056876
, iStuff mobile, Proceedings of the SIGCHI conference on Human factors in computing systems , CHI '07, pp.1107-1116, 2007.
DOI : 10.1145/1240624.1240793
, Model-Based Engineering of Widgets, User Applications and Servers Compliant with ARINC 661 Specification, Interactive Systems. Design, Specification, and Verification, pp.25-38, 2007.
DOI : 10.1007/978-3-540-69554-7_3
URL : https://hal.archives-ouvertes.fr/hal-01021771
, Ed Baroth et Chris Hartsough Visual programming in the real world. Visual object-oriented programming : concepts and environments, pp.21-42, 1995.
, The design and implementation of hierarchical software systems with reusable components, ACM Transactions on Software Engineering and Methodology, vol.1, issue.4, pp.355-398, 1992.
DOI : 10.1145/136586.136587
, Reification, polymorphism and reuse, Proceedings of the working conference on Advanced visual interfaces , AVI '00, pp.102-109, 2000.
DOI : 10.1145/345513.345267
, The perceptual window : Head motion as a new input stream, Proc. Interact99, 1999.
, Trends in the living room and beyond, Computers in Entertainment, vol.6, issue.1, pp.1-23, 2008.
DOI : 10.1145/1350843.1350848
, Real time programming : special purpose or general purpose languages, Centre de Mathématiques Appliquées - CMA -Mines ParisTech -INRIA, 1989.
URL : https://hal.archives-ouvertes.fr/inria-00075494
, Making components contract aware, Computer, vol.32, issue.7, pp.38-45, 1999.
DOI : 10.1109/2.774917
, Introduction to serviceoriented programming (rev 2.1) OpenWings Whitepaper, 2001.
, Constructing Programs from Example Computations, IEEE Transactions on Software Engineering, vol.2, issue.3, 1976.
DOI : 10.1109/TSE.1976.233812
, Programming rich interactions using the hierarchical state machine toolkit, Proceedings of the working conference on Advanced visual interfaces , AVI '06, pp.51-58, 2006.
DOI : 10.1145/1133265.1133275
, Rake cursor, Proceedings of the 27th international conference on Human factors in computing systems, CHI 09, pp.1415-1418, 2009.
DOI : 10.1145/1518701.1518914
URL : https://hal.archives-ouvertes.fr/hal-00953296
, Architecture logicielle et outils pour les interfaces hommes-machines graphiques avancées, 2005.
, Two-handed gesture in multi-modal natural dialog, Proceedings of the 5th annual ACM symposium on User interface software and technology , UIST '92, pp.7-14, 1992.
DOI : 10.1145/142621.142623
, Put-that-there : voice and gesture at the graphics interface, Proceedings of ISIGGRAPHÕ80, pp.262-270, 1980.
, Eyes at the interface, Proceedings of the 1982 conference on Human factors in computing systems, pp.360-362, 1982.
, The integrated multi-modal interface. Transactions of the, pp.70-2017, 1987.
, ICARE software components for rapidly developing multimodal interfaces, Proceedings of the 6th international conference on Multimodal interfaces , ICMI '04, pp.251-258, 2004.
DOI : 10.1145/1027933.1027975
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.106.83
, Catherine Oriat, et Ioannis Parissis. Formal testing of multimodal interactive systems, pp.36-52, 2008.
, ICARE : Approche à composants pour l'interaction multimodale, Actes des Premières Journées Francophones : Mobilité et Ubiquité, pp.36-43, 2004.
, Ingénierie de l'interaction multimodale en entrée Approche à composants ICARE, Thèse de doctorat, 2006.
, Outil de prototypage pour la conception et l'evaluation d'interfaces utilisateur multimodales, Proceedings of the 14th French-speaking conference on Human-computer interaction (Conf?rence Francophone sur l'Interaction Homme-Machine) , IHM '02, pp.239-242, 2002.
DOI : 10.1145/777005.777044
, Designing and prototyping multimodal commands, Human-Computer Interaction INTERACT'03, pp.717-720, 2003.
, The LilyPad Arduino, Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems , CHI '08, pp.423-432, 2008.
DOI : 10.1145/1357054.1357123
, A study in two-handed input, CHI '86 : Proceedings of the SIGCHI conference on Human factors in computing systems, pp.321-326, 1986.
, Lexical and pragmatic considerations of input structures, ACM SIGGRAPH, pp.31-37, 1983.
DOI : 10.1145/988584.988586
, Sketching User Experiences : Getting the Design Right and the Right Design, 2007.
, Toward real-time multimodal processing : Eyesweb 4.0, Proc. AISB 2004 Convention : Motion, Emotion and Cognition, 2004.
, A morphological analysis of the design space of input devices, ACM Transactions on Information Systems, vol.9, issue.2, pp.99-122, 1991.
DOI : 10.1145/123078.128726
, The point of the pen, BYTE, vol.16, issue.2, p.211, 1991.
, Vicon ; a visual icon manager, Visual Languages, pp.151-190, 1986.
, QuickSet, Proceedings of the fifth ACM international conference on Multimedia , MULTIMEDIA '97, pp.31-40, 1997.
DOI : 10.1145/266180.266328
, An open agent architecture, pp.197-204, 1998.
, Tangible multimodal interfaces for safety-critical applications, Communications of the ACM, vol.47, issue.1, pp.41-46, 2004.
DOI : 10.1145/962081.962103
, Capture et suivi du regard par un système de vision dans le contexte de la communication homme-machine, Thèse de doctorat, pp.15-1999, 1999.
, Component object model, 2009.
, A map-based system using speech and 3D gestures for pervasive computing, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces, p.191, 2002.
DOI : 10.1109/ICMI.2002.1166991
, NEIMO, a multiworkstation usability lab for observing and analyzing multimodal interaction, Conference companion on Human factors in computing systems common ground, CHI '96, pp.402-403, 1996.
DOI : 10.1145/257089.257904
, Joëlle Coutaz et Laurence Nigay Les propriétés CARE dans les interfaces multimodales, Actes de la conférence IHM'94, pp.7-14, 1994.
, Mod??le d'interaction mixte, Proceedings of the 2nd French-speaking conference on Mobility and uibquity computing , UbiMob '05, pp.153-160, 2005.
DOI : 10.1145/1102613.1102646
, SketchWizard, Proceedings of the 20th annual ACM symposium on User interface software and technology , UIST '07, pp.119-128, 2007.
DOI : 10.1145/1294211.1294233
, The rand tablet : a man-machine graphical communication device, fall joint computer conference, part I, AFIPS '64 (Fall, part I) : Proceedings of the, pp.325-331, 1964.
, DiamondTouch, Proceedings of the 14th annual ACM symposium on User interface software and technology , UIST '01, pp.219-226, 2001.
DOI : 10.1145/502348.502389
, Wizard of Oz Support throughout an Iterative Design Process, IEEE Pervasive Computing, vol.4, issue.4, pp.18-26, 2005.
DOI : 10.1109/MPRV.2005.93
, Smalltalk-80 : the language and its implementation, 1983.
, A demonstration of the openinterface interaction development environment, Adjunct Proceedings of UIST'07, pp.39-40, 2007.
, Cognitive dimensions of notations Human-Computer Interaction Specialist Group on People and computers V, Proceedings of the fifth, pp.443-460, 1989.
, Instructions and descriptions : some cognitive aspects of programming and similar activities, AVI '00 : Proceedings of the working conference on Advanced visual interfaces, pp.21-28, 2000.
, Usability evaluation considered harmful (some of the time), Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems , CHI '08, pp.111-120, 2008.
DOI : 10.1145/1357054.1357074
, Phidgets, Proceedings of the 14th annual ACM symposium on User interface software and technology , UIST '01, pp.209-218, 2001.
DOI : 10.1145/502348.502388
, Smallstar : programming by demonstration in the desktop metaphor. Watch what I do : programming by demonstration, pp.103-123, 1993.
, The synchronous dataflow programming language lustre, Proceedings of the IEEE, pp.1305-1320, 1991.
, The vocal joystick:, Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility , Assets '06, pp.197-204, 2006.
DOI : 10.1145/1168987.1169021
, Reflective physical prototyping through integrated design, test, and analysis, Proceedings of the 19th annual ACM symposium on User interface software and technology, UIST '06, pp.299-308, 2006.
DOI : 10.1145/1166253.1166300
, Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition, Proceedings of the SIGCHI conference on Human factors in computing systems , CHI '07, pp.145-154, 2007.
DOI : 10.1145/1240624.1240646
, Towards 3D hand tracking using a deformable model, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, p.140, 1996.
DOI : 10.1109/AFGR.1996.557255
, PHIGS - Programmer's Hierarchical Interactive Graphics System, Computer Graphics Forum, vol.3, issue.3, pp.299-300, 1984.
DOI : 10.1111/j.1467-8659.1984.tb00164.x
, Interaction and modeling techniques for desktop two-handed input, Proceedings of the 11th annual ACM symposium on User interface software and technology , UIST '98, pp.49-58, 1998.
DOI : 10.1145/288392.288572
, An overview of the sphinx-ii speech recognition system, HLT '93 : Proceedings of the workshop on Human Language Technology, pp.81-86, 1993.
, Voice as sound, Proceedings of the 14th annual ACM symposium on User interface software and technology , UIST '01, pp.155-156, 2001.
DOI : 10.1145/502348.502372
, Bringing Clay and Sand into Digital Design ??? Continuous Tangible user Interfaces, BT Technology Journal, vol.22, issue.4, pp.287-299, 2004.
DOI : 10.1023/B:BTTJ.0000047607.16164.16
, Advances in dataflow programming languages, ACM Computing Surveys, vol.36, issue.1, pp.1-34, 2004.
DOI : 10.1145/1013208.1013209
, "Get real!", CHI '07 extended abstracts on Human factors in computing systems , CHI '07, pp.1913-1916, 2007.
DOI : 10.1145/1240866.1240922
, Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality, Proceedings of the 5th international conference on Multimodal interfaces , ICMI '03, pp.12-19, 2003.
DOI : 10.1145/958432.958438
, An iterative design methodology for user-friendly natural language office information applications, ACM Transactions on Information Systems, vol.2, issue.1, pp.26-41, 1984.
DOI : 10.1145/357417.357420
, Suede, a wizard of oz prototyping tool for speech user interfaces, Proc. of UIST'00, pp.1-10, 2000.
, Interactive design of multimodal user interfaces, Journal on Multimodal User Interfaces, vol.10, issue.1, pp.197-213, 2010.
DOI : 10.1007/s12193-010-0044-2
, A cookbook for using the model-view controller user interface paradigm in smalltalk-80, J. Object Oriented Program, vol.1, issue.3, pp.26-49, 1988.
, Focus group., 2000.
DOI : 10.1037/10518-189
, An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components, Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, EICS '09, pp.245-254, 2009.
DOI : 10.1145/1570433.1570480
, Brain-Computer Interfaces, Virtual Reality, and Videogames, Computer, vol.41, issue.10, pp.4166-72, 2008.
DOI : 10.1109/MC.2008.410
, Julien Letessier et François Bérard Visual tracking of bare fingers for interactive surfaces, Proceedings of the 17th annual ACM symposium on User interface software and technology, pp.119-122, 2004.
, Topiary, Proceedings of the 17th annual ACM symposium on User interface software and technology , UIST '04, pp.217-226, 2004.
DOI : 10.1145/1029632.1029671
, Design Challenges and Principles for Wizard of Oz Testing of Location-Enhanced Applications, Proceedings of IEEE Pervasive Computing, pp.70-75, 2007.
DOI : 10.1109/MPRV.2007.28
, Constructing graphical user interfaces by example, Graphics Interface'82, pp.295-302, 1982.
, Mondrian, Proceedings of the SIGCHI conference on Human factors in computing systems , CHI '93, p.144, 1993.
DOI : 10.1145/169059.169120
, The anatomy of prototypes, ACM Transactions on Computer-Human Interaction, vol.15, issue.2, 2008.
DOI : 10.1145/1375761.1375762
, Augmented reality : linking real and virtual worlds : a new paradigm for interacting with computers, AVI '98 : Proceedings of the working conference on Advanced visual interfaces, pp.13-21, 1998.
, Interacting with large displays from a distance with vision-tracked multi-finger gestural input, UIST '05 : Proceedings of the 18th annual ACM symposium on User interface software and technology, pp.43-52, 2005.
, The open agent architecture: A framework for building distributed software systems, Applied Artificial Intelligence, vol.13, issue.1-2, pp.91-128, 1999.
DOI : 10.1080/088395199117504
, Une utilisation du mod??le MVC pour une plate-forme de travail virtuel, Proceedings of the 17th conference on 17??me Conf??rence Francophone sur l'Interaction Homme-Machine , IHM 2005, pp.131-138, 2005.
DOI : 10.1145/1148550.1148567
, Tycoon six primitive types of cooperation for observing, evaluating and specifying cooperations, AAAI Technical Report FS- 99-03, 1999.
, Pépinière d'expérimentation scientifique du laboratoire d'informatique de grenoble, 2009.
, Breaking the fidelity barrier, Proceedings of the SIGCHI conference on Human Factors in computing systems , CHI '06, pp.1233-1242, 2006.
DOI : 10.1145/1124772.1124959
, User evaluation of OIDE, Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, EICS '09, pp.237-242, 2009.
DOI : 10.1145/1570433.1570476
, Brain-computer interaction, UIST '06 : Proceedings of the 19th annual ACM symposium on User interface software and technology, pp.277-278, 2006.
, Garnet : comprehensive support for graphical, highly interactive user interfaces. Human-computer interaction : toward the year 2000, pp.357-372, 1995.
, Past, present, and future of user interface software tools, ACM Transactions on Computer-Human Interaction, vol.7, issue.1, pp.3-28, 2000.
DOI : 10.1145/344949.344959
, Creating highlyinteractive and graphical user interfaces by demonstration, SIGGRAPH '86 : Proceedings of the 13th annual conference on Computer graphics and interactive techniques, pp.249-258, 1986.
, Visual programming, programming by example, and program visualization : a taxonomy, CHI '86 : Proceedings of the SIGCHI conference on Human factors in computing systems, pp.59-66, 1986.
, Separating application code from toolkits : eliminating the spaghetti of call-backs, UIST '91 : Proceedings of the 4th annual ACM symposium on User interface software and technology, pp.211-220, 1991.
, A brief history of human computer interaction technology, ACM interactions, vol.5, issue.2, pp.44-54, 1998.
, A Formal Approach for User Interaction Reconfiguration of Safety Critical Interactive Systems, SAFECOMP '08 : Proceedings of the 27th international conference on Computer Safety, Reliability, and Security, pp.373-386, 2008.
DOI : 10.1007/978-3-540-87698-4_31
, A preliminary analysis of the products of hci research, using pro forma abstracts, CHI '94 : Proceedings of the SIGCHI conference on Human factors in computing systems, pp.278-284, 1994.
, Building user interfaces : Organizing software agents, Proc. ESPRIT'91 conference, pp.707-719, 1991.
, Espaces conceptuels pour l'interaction multimédia et multimodale. TSI, spécial Multimédia et Collecticiel, pp.1195-1225, 1996.
, Evaluating user interface systems research, UIST '07 : Proceedings of the 20th annual ACM symposium on User interface software and technology, pp.251-258, 2007.
, SenseShapes: using statistical geometry for object selection in a multimodal augmented reality, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings., p.300, 2003.
DOI : 10.1109/ISMAR.2003.1240730
, AirMice : Finger gesture for 2D and 3D interaction, Conference Proceedings of INTERACT '09, the 280 BIBLIOGRAPHIE Twelfth IFIP TC13 International Conference on Human-Computer Interaction, Springer LNCS (Lecture Notes in Computer Science), 2009.
, Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions, Human-Computer Interaction, vol.26, issue.4, pp.263-322, 2000.
DOI : 10.1109/6046.807953
, Individual differences in multimodal integration patterns, Proceedings of the SIGCHI conference on Human factors in computing systems , CHI '05, pp.241-249, 2005.
DOI : 10.1145/1054972.1055006
, Ten myths of multimodal interaction, Communications of the ACM, vol.42, issue.11, pp.74-81, 1999.
DOI : 10.1145/319382.319398
, Sibertin-Blanc. Formal specification, design and validation of user-driven interfaces using a petri net and objects based model, Research Symposium INTERCHI'93, 1993.
, Beyond usability for safety critical systems, CHI '07 extended abstracts on Human factors in computing systems , CHI '07, pp.2133-2136, 2007.
DOI : 10.1145/1240866.1240966
, Kommunikation mit automaten, Bonn : Institute f/Jr Instrumentelle Mathematik, 1962.
, Pfaff et Ten Hagen. Uims, Seeheim workshop on User Interface Management Systems, 1985.
, GKS-3D: A Three-Dimensional Extension to the Graphical Kernel System, IEEE Computer Graphics and Applications, vol.6, issue.8, pp.42-49, 1986.
DOI : 10.1109/MCG.1986.276768
, Processing : a learning environment for creating interactive web graphics, ACM SIGGRAPH 2003 Web Graphics, 2003.
, Présentation multimodale et contextuelle de l'information, Thèse de doctorat, pp.13-2006, 2006.
, Agent-based architecture for implementing multimodal learning environments for visually impaired children, Proceedings of the 7th international conference on Multimodal interfaces , ICMI '05, pp.309-316, 2005.
DOI : 10.1145/1088463.1088516
, A Wizard of Oz platform for the study of multimodal systems, INTERACT '93 and CHI '93 conference companion on Human factors in computing systems , CHI '93, pp.95-96, 1993.
DOI : 10.1145/259964.260126
, Le projet NEIMO : une plate-forme magicien d'oz multimodale, IHM'92, pp.66-71, 1992.
, La programmation sur exemple : principes, utilisation et utilité pour les applications interactives, Ergo'IA 2006, pp.201-208, 2006.
, Rapid prototyping using visual programming tools, CHI '96 : Conference companion on Human factors in computing systems, pp.359-360, 1996.
, Formal description of a multimodal interaction technique in an immersive virtual reality application, Proceedings of the 15th French-speaking conference on human-computer interaction on 15eme Conference Francophone sur l'Interaction Homme-Machine , IHM 2003, pp.150-157, 2003.
DOI : 10.1145/1063669.1063690
, Multimodal interaction on mobile phones, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services , MobileHCI '06, pp.129-136, 2006.
DOI : 10.1145/1152215.1152242
, Temporal aspects of CARE-based multimodal fusion, Proceedings of the 2009 international conference on Multimodal interfaces, ICMI-MLMI '09, pp.177-184, 2009.
DOI : 10.1145/1647314.1647346
URL : https://hal.archives-ouvertes.fr/hal-00953294
, Inferring lisp programs from examples, IJCAI'75 : Proceedings of the 4th international joint conference on Artificial intelligence, pp.260-267, 1975.
, Direct manipulation : A step beyond programming languages. Human-computer interaction : a multidisciplinary approach, pp.461-467, 1987.
, Direct manipulation for comprehensible, predictable and controllable user interfaces, Proceedings of the 2nd international conference on Intelligent user interfaces , IUI '97, pp.33-39, 1997.
DOI : 10.1145/238218.238281
, Druid: a system for demonstrational rapid user interface development, Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology , UIST '90, pp.167-177, 1990.
DOI : 10.1145/97924.97943
, Capturing user tests in a multimodal, multidevice informal prototyping tool, Proceedings of the 5th international conference on Multimodal interfaces , ICMI '03, pp.117-124, 2003.
DOI : 10.1145/958432.958457
, Use of eye movements for video game control, Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology , ACE '06, 2006.
DOI : 10.1145/1178823.1178847
, Pygmalion : a creative programming environment, Thèse de doctorat, 1975.
, Component Software : Beyond Object-Oriented Programming, 2002.
, Component technology - what, where, and how?, 25th International Conference on Software Engineering, 2003. Proceedings., pp.684-693, 2003.
DOI : 10.1109/ICSE.2003.1201255
, A gentle introduction to OSGi, ACM SIGSOFT Software Engineering Notes, vol.33, issue.5, pp.1-5, 2008.
DOI : 10.1145/1402521.1402526
, Argus : Real-time handwritten characterrecognition system, 1963.
, Objective viewpoint: make your GUI swing, Crossroads, vol.6, issue.4, pp.3-5, 2000.
DOI : 10.1145/333424.333428