.. Taxonomy-labels, 59 3.2 Turn-taking phenomena taxonomy. The rows/columns correspond to the levels of information added by the floor holder/taker, p.60

. Aist, Incremental understanding in human-computer dialogue and experimental evidence for advantages over nonincremental methods, Proceedings of the 11th Workshop on the Semantics and Pragmatics of Dialogue, 2007.

K. Anand, G. S. Anand, and . Kahn, Making sense of gigabytes: A system for knowledge-based market analysis, Proceedings of Innovative Applications of Artificial Intelligence (IAAI), 1992.

. Arnold, The rapid use of gender information: evidence of the time course of pronoun resolution from eyetracking, Cognition, vol.76, issue.1, pp.13-26, 2000.
DOI : 10.1016/S0010-0277(00)00073-1

. Asri, Scorebased inverse reinforcement learning, Proceedings of International Conference on Autonomous Agents and Multiagent Systems, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01406886

. Auer, Finite-time analysis of the multiarmed bandit problem, Machine Learning, vol.47, issue.2/3, pp.235-256, 2002.
DOI : 10.1023/A:1013689704352

O. Auer, R. Auer, and . Ortner, Online-regret bounds for a new reinforcement-learning algorithm, Proceedings of 1st Austrian Cognitive Vision Workshop, 2005.

O. Auer, R. Auer, and . Ortner, Logarithmic online regret bounds for undiscounted reinforcement learning, Proceedings of Advances in Neural Information Processing Systems (NIPS), 2006.

). J. Austin, How to Do Things with Words, 1962.
DOI : 10.1093/acprof:oso/9780198245537.001.0001

. Barlier, Human-Machine Dialogue as a Stochastic Game, Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2015.
DOI : 10.18653/v1/W15-4602

URL : https://hal.archives-ouvertes.fr/hal-01225848

A. G. Barto and S. Mahadevan, Recent advances in hierarchical reinforcement learning, Discrete Event Dynamic Systems, vol.13, issue.1/2, pp.41-77, 2003.
DOI : 10.1023/A:1022140919877

). T. Baumann, Simulating spoken dialogue with a focus on realistic turn-taking, Proceedings of the 5th International Workshop on Constraints and Language Processing (CSLP), 2008.

). T. Baumann, Partial representations improve the prosody of incremental speech synthesis, Proceedings of Interspeech, 2014.

). T. Baumann and D. Schlangen, Evaluation and Optimisation of Incremental Processors, Dialogue & Discourse, vol.2, issue.1, pp.113-141, 2011.
DOI : 10.5087/dad.2011.106

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.233.4341

). T. Baumann and D. Schlangen, Open-ended, extensible system utterances are preferred, even if they require filled pauses, Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2013.

). G. Beattie, Turn-taking and interruption in political interviews: Margaret Thatcher and Jim Callaghan compared and contrasted, Semiotica, vol.39, issue.1-2, pp.93-114, 1982.
DOI : 10.1515/semi.1982.39.1-2.93

. Bengio, Neural Probabilistic Language Models, The Journal of Machine Learning Research, vol.3, pp.1137-1155, 2003.
DOI : 10.1007/3-540-33486-6_6

URL : https://hal.archives-ouvertes.fr/hal-01434258

F. A. Berry, B. Berry, and . Fristedt, Bandit problems : sequential allocation of experiments, 1985.
DOI : 10.1007/978-94-015-3711-7

D. J. Bradtke, M. O. Bradtke, and . Duff, Reinforcement learning methods for continuous-time markov decision problems, Proceedings of Advances in Neural Information Processing Systems (NIPS), 1994.

. Bratman, Plans and resource-bounded practical reasoning, Computational Intelligence, vol.2, issue.3, pp.349-355, 1988.
DOI : 10.1016/0004-3702(84)90053-5

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.12.3487

. Breslin, Continuous asr for flexible incremental dialogue, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.8362-8366, 2013.
DOI : 10.1109/ICASSP.2013.6639296

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.409.6297

C. Bubeck, N. Bubeck, and . Cesa-bianchi, Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems, Foundations and Trends?? in Machine Learning, vol.5, issue.1, pp.1-122, 2012.
DOI : 10.1561/2200000024

URL : http://arxiv.org/abs/1204.5721

. Chandramohan, User simulation in dialogue systems using inverse reinforcement learning, Proceedings of INTERSPEECH, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00652446

. Chandramohan, Behavior specific user simulation in spoken dialogue systems, Proceedings of Speech Communication; 10th ITG Symposium, pp.1-4, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00749421

. Chandramohan, Clustering behaviors of Spoken Dialogue Systems users, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.4981-4984, 2012.
DOI : 10.1109/ICASSP.2012.6289038

URL : https://hal.archives-ouvertes.fr/hal-00685009

. Chandramohan, Optimizing spoken dialogue management with fitted value iteration, Proceedings of INTERSPEECH 11th Annual Conference of the International Speech, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00553184

T. C. Chao, A. L. Chao, and . Thomaz, Timing in Multimodal Turn-Taking Interactions: Control and Analysis Using Timed Petri Nets, Journal of Human-Robot Interaction, 2012.
DOI : 10.5898/JHRI.1.1.Chao

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.419.3105

). H. Clark, Using Language, 1996.

C. , B. Claus, and C. Boutilier, The dynamics of reinforcement learning in cooperative multiagent systems, Proceedings of the Fifteenth National/Tenth Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence , AAAI '98/IAAI '98, 1998.

L. P. Cohen, H. J. Cohen, and . Levesque, Persistence, Intention, and Commitment, Proceedings of Intentions in Communication, 1990.
DOI : 10.1016/B978-0-934613-30-9.50016-0

URL : http://www.dtic.mil/get-tr-doc/pdf?AD=ADA461012

. Collobert, Natural language processing (almost) from scratch, 2011.

. Cuayáhuitl, Strategic dialogue management via deep reinforcement learning, Proceedings of NIPS Workshop on Deep Reinforcement Learning, 2015.

. Cuayáhuitl, Hierarchical dialogue optimization using semi-markov decision processes, Proceedings of Interspeech, 2007.

. Daubigney, Model-free pomdp optimisation of tutoring systems with echo-state networks, Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00869773

E. Asri, Compact and Interpretable Dialogue State Representation with Genetic Sparse Distributed Memory, Proceedings of International Workshop Series on Spoken Dialogue Systems Technology (IWSDS), 2016.
DOI : 10.1007/978-981-10-2585-3_3

URL : https://hal.archives-ouvertes.fr/hal-01406873

E. Asri, NASTIA: Negotiating Appointment Setting Interface, Proceedings of LREC, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01107492

. Evanini, Caller Experience: A method for evaluating dialog systems and its automatic prediction, 2008 IEEE Spoken Language Technology Workshop, 2008.
DOI : 10.1109/SLT.2008.4777857

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.359.7660

A. Ferguson, J. F. Ferguson, and . Allen, Mixed-initiative systems for collaborative problem solving, 2007.

. Ferreira, Online adaptative zero-shot learning spoken language understanding using word-embedding, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015.
DOI : 10.1109/ICASSP.2015.7178987

. Ferreira, Zero-shot semantic parser for spoken language understanding, Proceedings of INTERSPEECH, 2015.

L. E. Ferreira, F. Ferreira, and . Lefèvre, Social signal and user adaptation in reinforcement learning-based dialogue management, Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems Bridging the Gap Between Perception, Action and Communication, MLIS '13, 2013.
DOI : 10.1145/2493525.2493535

URL : https://hal.archives-ouvertes.fr/hal-01315527

L. E. Ferreira, F. Ferreira, and . Lefèvre, Reinforcement-learning based dialogue system for human???robot interactions with socially-inspired rewards, Computer Speech & Language, vol.34, issue.1, pp.256-274, 2015.
DOI : 10.1016/j.csl.2015.03.007

. Ferreira, Users??? Belief Awareness in Reinforcement Learning-Based Situated Human???Robot Dialogue Management, Proceedings of IWSDS, 2015.
DOI : 10.1007/978-3-319-19291-8_7

. Ferreira, Adversarial Bandit for online interactive active learning of zero-shot spoken language understanding, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016.
DOI : 10.1109/ICASSP.2016.7472860

. Fink, Incremental speech recognition for multimodal interfaces, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200), 1998.
DOI : 10.1109/IECON.1998.724027

M. Gales and S. Young, The application of hidden markov models in speech recognition. Found. Trends Signal Process, 2007.

. Galibert, An open-domain, human-computer dialog system, Proceedings of INTERSPEECH, 2005.

. Gasic, Pomdp-based dialogue manager adaptation to extended domains, Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2013.
DOI : 10.1109/tasl.2013.2282190

. Gelin, Towards a storytelling humanoid robot, Proceedings of Workshop "Dialog with Robots", AAAI Fall Sympo- sium, 2010.

. Ghigi, Incremental dialog processing in a task-oriented dialog, Proceedings of Fifteenth Annual Conference of the International Speech Communication Association, 2014.

H. A. Gravano, J. Gravano, and . Hirschberg, Turn-taking cues in task-oriented dialogue, Computer Speech & Language, vol.25, issue.3, pp.601-634, 2011.
DOI : 10.1016/j.csl.2010.10.003

. Hahn, Comparing Stochastic Approaches to Spoken Language Understanding in Multiple Languages, IEEE Transactions on Audio, Speech, and Language Processing, vol.19, issue.6, pp.1569-1583, 2010.
DOI : 10.1109/TASL.2010.2093520

URL : https://hal.archives-ouvertes.fr/hal-00746965

. Hastie, Tsiakoulis, and Y. Vanrompay, 2013. Demonstration of the parlance system: a data-driven incremental, spoken dialogue system for interactive search, Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2013.

. Hirasawa, Effects of system barge-in responses on user impressions, Proceedings of EU- ROSPEECH, 1999.

G. S. Hone, R. Hone, and . Graham, Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI), Natural Language Engineering, vol.6, issue.3&4, pp.287-303, 2000.
DOI : 10.1017/S1351324900002497

. Huet, Factored machine translation systems for russian-english. the Eighth Workshop on Statistical Machine Translation, pp.152-155, 2013.

S. Ilkin, Active prediction of syntactic information during sentence processing, Dialogue & Discourse, vol.2, issue.1, pp.35-58, 2011.
DOI : 10.5087/dad.2011.103

URL : http://dad.uni-bielefeld.de/index.php/dad/article/download/224/1456

M. E. Israel, J. G. Israel, and . Mitchell, Separating data from function in a distributed file system, Proceedings of Second International Symposium on Operating Systems Theory and Practice, 1978.

. Khouzaimi, Incremental Human-Machine Dialogue Simulation, Proceedings of the International Workshop on Spoken Dialogue Systems (IWSDS), 2016.
DOI : 10.1007/978-981-10-2585-3_4

. Khouzaimi, Reinforcement learning for turn-taking management in incremental spoken dialogue systems, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), 2016.

F. Kilger, W. Kilger, and . Finkler, Incremental generation for real-time applications, German Research Center for Artificial Intelligence, 1995.

B. S. Kim, R. E. Kim, and . Banchs, Sequential Labeling for Tracking Dynamic Dialog States, Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014.
DOI : 10.3115/v1/W14-4345

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.675.696

P. Konolige, M. E. Konolige, and . Pollack, A representationalist theory of intention, Proceedings of the 13th International Joint Conference on Artifical Intelligence (IJCAI), 1993.

. Lamel, The LIMSI Arise system, The LIMSI ARISE System, pp.339-354, 2000.
DOI : 10.1016/S0167-6393(99)00067-9

). R. Laroche, Raisonnement sur les incertitudes et apprentissage pour les systemes de dialogue conventionnels, 2010.

). R. Laroche, CFAsT : Content Finder AssistanT, Proceedings of the 21st Conférence sur le Traitement Automatique des Langues Naturelles (TALN), 2014.
DOI : 10.1109/icin.2015.7073836

). R. Laroche, Content finder AssistanT, 2015 18th International Conference on Intelligence in Next Generation Networks, 2015.
DOI : 10.1109/ICIN.2015.7073836

. Laroche, Uncertainty management in dialogue systems, Proceedings of European Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, 2008.
URL : https://hal.archives-ouvertes.fr/hal-01299455

. Laroche, Final evaluation of classic towninfo and appointment scheduling systems, D6, vol.4, 2011.

. Laroche, Cooking coach spoken/multimodal dialogue systems, Proceedings of the IJCAI Workshop on Cooking with Computers, 2013.

. Lefèvre, Leveraging study of robustness and portability of spoken language understanding systems across languages and domains: the portmedia corpora, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), 2012.

. Lemon, Managing dialogue interaction: A multi-layered approach, Proceedings of the 4th SIGDIAL Workshop on Discourse and Dialogue, 2003.

. Lemon, An ISU dialogue system exhibiting reinforcement learning of dialogue policies, Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics: Posters & Demonstrations on, EACL '06, pp.6-119, 2006.
DOI : 10.3115/1608974.1608986

). O. Lemon and O. Pietquin, Machine learning for spoken dialogue systems, Proceedings of the European Conference on Speech Communication and Technologies (Interspeech'07), 2007.
URL : https://hal.archives-ouvertes.fr/hal-00216035

). W. Levelt, Speaking: From Intention to Articulation, 1989.

P. Levin, R. Levin, and . Pieraccini, A stochastic model of computer-human interaction for learning dialogue strategies, Proceedings of In EUROSPEECH 97, 1997.

. Levin, Learning dialogue strategies within the Markov decision process framework, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings, 1997.
DOI : 10.1109/ASRU.1997.658989

). K. Lock, Structuring programs for multiprogram time-sharing online applications, Proceedings of AFIPS '65 (Fall, part I), 1965.
DOI : 10.1145/1463891.1463941

). V. Louis, Conception et mise en oeuvre de modèles formels du calcul de plans d'action complexes par un agent rationnel dialoguant, 2002.

. Lu, Decision of response timing for incremental speech recognition with reinforcement learning, 2011 IEEE Workshop on Automatic Speech Recognition & Understanding, 2011.
DOI : 10.1109/ASRU.2011.6163976

. Mairesse, Phrase-based statistical language generation using graphical models and active learning Association for Computational Linguis- tics, Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp.1552-1561, 2010.

. Manishina, Automatic corpus extension for data-driven natural language generation, Proceedings of the Language Resources and Evaluation Conference (LREC), 2016.

L. Panait, S. Panait, and . Luke, Cooperative Multi-Agent Learning: The State of the Art, Autonomous Agents and Multi-Agent Systems, vol.4, issue.2-3, pp.387-434, 2005.
DOI : 10.1007/s10458-005-2631-2

H. Pieraccini, J. Pieraccini, and . Huerta, Where do we go from here? research and commercial spoken dialog systems, Proceedings of the 6th SIGDIAL Workshop on Discourse and Dialogue, 2005.

B. Pietquin, R. Pietquin, and . Beaufort, Comparing asr modeling methods for spoken dialogue simulation and optimal strategy learning, Proceedings of 9th European Conference on Speech Communication and Technology (Eu- rospeech/Interspeech), 2005.

D. Pietquin, T. Pietquin, and . Dutoit, A probabilistic framework for dialog simulation and optimal strategy learning, IEEE Transactions on Audio, Speech and Language Processing, vol.14, issue.2, pp.589-599, 2006.
DOI : 10.1109/TSA.2005.855836

URL : https://hal.archives-ouvertes.fr/hal-00207952

H. O. Pietquin, H. Pietquin, and . Hastie, A survey on metrics for the evaluation of user simulations, The Knowledge Engineering Review, vol.11, issue.01, 2013.
DOI : 10.1016/j.csl.2009.03.002

URL : https://hal.archives-ouvertes.fr/hal-00771654

J. O. Plátek, F. Plátek, and . Jur?í?ek, Free on-line speech recogniser based on Kaldi ASR toolkit producing word posterior lattices, Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014.
DOI : 10.3115/v1/W14-4315

. Potet, The liga (lig/lia) machine translation system for wmt 2011, Proceedings of the Sixth Workshop on Statistical Machine Translation, pp.440-446, 2011.

. Povey, The kaldi speech recognition toolkit, Proceedings of IEEE 2011 Workshop on Automatic Speech Recognition and Understanding, 2011.

. Putois, Enhanced monitoring tools and online dialogue optimisation merged into a new spoken dialogue system design experience, Proceedings of the 11h Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2010.

E. Raux, M. Raux, and . Eskenazi, A multi-layer architecture for semi-synchronous event-driven dialogue management, 2007 IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU), 2007.
DOI : 10.1109/ASRU.2007.4430165

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.72.3776

E. Raux, M. Raux, and . Eskenazi, Optimizing endpointing thresholds using dialogue features in a spoken dialogue system, Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, SIGdial '08, 2008.
DOI : 10.3115/1622064.1622066

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.142.1092

). E. Schegloff, Sequencing in Conversational Openings, American Anthropologist, vol.70, issue.6, pp.1075-1095, 1968.
DOI : 10.1525/aa.1968.70.6.02a00030

S. Schlangen, G. Schlangen, and . Skantze, "A General, Abstract Model of Incremental Dialogue Processing", Dialogue & Discourse, vol.2, issue.1, pp.83-111, 2011.
DOI : 10.5087/dad.2011.105

. Schmitt, A parameterized and annotated spoken dialog corpus of the cmu let's go bus information system, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), 2012.

. Schultz, Reward-related signals carried by dopamine neurons, Proceedings of Models of Information Processing in the Basal Ganglia, pp.233-248, 1995.

). J. Searle, Austin on Locutionary and Illocutionary Acts, The Philosophical Review, vol.77, issue.4, 1968.
DOI : 10.2307/2183008

M. S. Seigel and P. C. Woodland, Combining information sources for confidence estimation with crf models, Proceedings of INTER- SPEECH, 2011.

H. Selfridge, P. A. Selfridge, and . Heeman, Importance-driven turn-bidding for spoken dialogue systems, Proceedings of ACL, pp.177-185, 2010.

. Selfridge, Stability and accuracy in incremental speech recognition, Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2011.

. Selfridge, Integrating incremental speech recognition and pomdp-based dialogue systems, Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2012.

H. E. Selfridge, P. A. Selfridge, and . Heeman, A temporal simulator for developing turn-taking methods for spoken dialogue systems, Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2012.

. Sidner, Demonstration of an always-on companion for isolated older adults, Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2013.

. Singh, Optimizing dialogue management with reinforcement learning: Experiments with the njfun system, Journal of Artificial Intelligence Research, pp.105-133, 2002.

. Singh, Reinforcement learning for spoken dialogue systems, Proceedings of Advances in Neural Information Processing Systems (NIPS), 1999.

J. G. Skantze, M. Skantze, and . Johansson, Modelling situated human-robot interaction using IrisTK, Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2015.
DOI : 10.18653/v1/W15-4624

G. Skantze and D. Schlangen, Incremental dialogue processing in a micro-domain, Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics on, EACL '09, 2009.
DOI : 10.3115/1609067.1609150

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.148.8871

. Strombergsson, Timing responses to questions in dialogue, Proceedings of IN- TERSPEECH Proceedings, 2013.

). H. Sullivan, Conceptions of Modern Psychiatry, Psychiatry, vol.3, issue.1, 1947.
DOI : 10.1080/00332747.1940.11022272

B. S. Sutton, A. G. Sutton, and . Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

B. Tabet, M. Tabet, and . Boughazi, Speech synthesis techniques. A survey, International Workshop on Systems, Signal Processing and their Applications, WOSSPA, 2011.
DOI : 10.1109/WOSSPA.2011.5931414

. Tanenhaus, Integration of visual and linguistic information in spoken language comprehension, Science, vol.268, issue.5217, pp.1632-1634, 1995.
DOI : 10.1126/science.7777863

). B. Thomson and S. J. Young, Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems, Computer Speech & Language, vol.24, issue.4, pp.562-588, 2010.
DOI : 10.1016/j.csl.2009.07.003

URL : https://hal.archives-ouvertes.fr/hal-00621617

). E. Thorndike, Animal intelligence: An experimental study of the associative processes in animals, 1898.

. Vogel, Emergence of gricean maxims from multi-agent decision theory, Proceedings of Conference of the North American Chapter of the Association of Computational Linguistics (NAACL), 2013.

. Walker, Paradise: a framework for evaluating spoken dialogue agents, Proceedings of the eighth conference on European chapter, 1997.