H. David, M. L. Ackley, and . Littman, Altruism in the evolution of communication, Artificial life IV, pp.40-48, 1994.

T. Alkire and C. Rosen, Romance languages: a historical introduction, 2010.

P. Andry, P. Gaussier, S. Moga, J. Banquet, and J. Nadel, Learning and communication via imitation: An autonomous robot perspective. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, vol.31, issue.5, pp.431-442, 2001.

P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, Contour detection and hierarchical image segmentation, IEEE transactions on pattern analysis and machine intelligence, vol.33, pp.898-916, 2011.

A. Baicchi, Complex adaptive systems: The case of language, Construction Learning as a Complex Adaptive System, pp.9-31, 2015.

G. Baldassarre and M. Mirolli, Deciding which skill to learn when: temporal-difference competence-based intrinsic motivation (td-cbim), Intrinsically Motivated Learning in Natural and Artificial Systems, pp.257-278, 2013.

G. Baldassarre and M. Mirolli, Intrinsically motivated learning in natural and artificial systems, 2013.

A. Baranès and P. Oudeyer, R-iac: Robust intrinsically motivated exploration and active learning, IEEE Transactions on Autonomous Mental Development, vol.1, issue.3, pp.155-169, 2009.

A. Baranès and P. Oudeyer, Intrinsically motivated goal exploration for active motor learning in robots: a case study, IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010.

A. Baranès and P. Oudeyer, Active learning of inverse models with intrinsically motivated goal exploration in robots, Robotics and Autonomous Systems, vol.61, issue.1, pp.49-73, 2013.

A. Baronchelli, T. Gong, A. Puglisi, and V. Loreto, Modeling the emergence of universality in color naming patterns, Proceedings of the National Academy of Sciences, vol.107, issue.6, pp.2403-2407, 2010.

A. Baronchelli, V. Loreto, and A. Puglisi, Individual biases, cultural evolution, and the statistical nature of language universals: The case of colour naming systems, PLoS ONE, vol.10, issue.5, pp.1-19, 2015.

A. G. Barto, S. Singh, and N. Chentanez, Intrinsically motivated learning of hierarchical collections of skills, Proc. 3rd Int. Conf. Development Learn, pp.112-119, 2004.

C. Beckner, R. Blythe, J. Bybee, M. H. Christiansen, W. Croft et al., Language is a complex adaptive system: Position paper, Language learning, vol.59, issue.s1, pp.1-26, 2009.

T. Belpaeme and J. Bleys, Language, perceptual categories and their interaction: Insights from computational modelling, Emergence of Communication and Language, pp.339-353, 2007.

B. Berlin and P. Kay, Basic color terms: Their universality and evolution, 1969.

D. E. Berlyne, A theory of human curiosity, British Journal of Psychology. General Section, vol.45, issue.3, pp.180-191, 1954.

K. Beuls, Towards an agent-based tutoring system for Spanish verb conjugation, 2013.

K. Beuls and L. Steels, Agent-based models of strategies for the emergence and evolution of grammatical agreement, PLOS ONE, vol.8, issue.3, p.58960, 2013.

H. Mark and . Bickhard, Scaffolding and self-scaffolding: Central aspects of development, Children's development within social context, vol.1, issue.2, pp.33-52, 1992.

J. Bleys, Language Strategies for the Domain of Colour, 2010.

J. Bleys, Language strategies for color, Experiments in Cultural Language Evolution, pp.61-85, 2012.

J. Bleys, Language strategies for the domain of colour, 2015.

J. Bleys, M. Loetzsch, M. Spranger, and L. Steels, The Grounded Color Naming Game, Proceedings of the 18th IEEE International Symposium on Robot and Human Interactive Communication, 2009.

J. Bleys and L. Steels, Linguistic selection of language strategies, European Conference on Artificial Life, pp.150-157, 2009.

E. J. Briscoe, Language as a complex adaptive system: co-evolution of language and of the language acquisition device, Proceedings of Eighth Computational Linguistics in the Netherlands Conference. Citeseer, 1998.

T. Briscoe, Co-evolution of language and of the language acquisition device, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, pp.418-427, 1997.

C. Richard-de, Personal Causation: The Internal Affective Determinants of Behavior, 1968.

N. Chomsky, Aspects of the Theory of Syntax, 1965.

S. Coradeschi and A. Saffiotti, An introduction to the anchoring problem, Robotics and Autonomous Systems, vol.43, issue.2, pp.85-96, 2003.

M. Cornudella, T. Poibeau, and R. Van-trijp, The role of intrinsic motivation in artificial language emergence: a case study on colour, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp.1646-1656, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01422478

M. Cornudella, P. Van-eecke, and R. Van-trijp, How intrinsic motivation can speed up language emergence, Proceedings of the European Conference on Artificial Life, pp.571-578, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01481054

L. P. Crespi, Amount of reinforcement and level of performance, Psychological Review, vol.51, issue.6, p.341, 1944.

W. Croft and D. Cruse, Cognitive linguistics, 2004.

M. Csíkszentmihályi, Beyond Boredom and Anxiety, 1975.

M. Csíkszentmihályi, Flow: The psychology of optimal experience, 1990.

J. De-beule, The emergence of compositionality, hierarchy and recursion in peer-to-peer interactions, Proceedings of the 7th international conference on the evolution of language, pp.75-82, 2008.

J. De-beule, B. D. Vylder, and T. Belpaeme, A cross-situational learning algorithm for damping homonymy in the guessing game, Artificial Life X, pp.466-472, 2006.

L. Edward, R. M. Deci, and . Ryan, Intrinsic Motivation and SelfDetermination in Human Behavior, 1985.

L. Edward, R. M. Deci, and . Ryan, Motivation, personality, and development within embedded social contexts: An overview of selfdetermination theory. The Oxford handbook of human motivation, pp.85-107, 2012.

D. M. Early, J. K. Berg, S. Alicea, Y. Si, J. L. Aber et al., The impact of every classroom, every day on high school student achievement: Results from a schoolrandomized trial, Journal of Research on Educational Effectiveness, vol.9, issue.1, pp.3-29, 2016.

N. C. Ellis, The emergence of language as a complex adaptive system. The Routledge handbook of applied linguistics, vol.666679, 2011.

L. Festinger, A theory of cognitive dissonance, vol.2, 1962.

C. J. Fillmore, The mechanisms of "construction grammar, Annual Meeting of the Berkeley Linguistics Society, vol.14, pp.35-55, 1988.

J. Gao and U. Sutrop, The basic color terms of mandarin chinese: A theory-driven experimental study. Studies in Language. International Journal sponsored by the Foundation "Foundations of Language, vol.38, pp.335-359, 2014.

E. Garcia and C. , Insight grammar learning, Journal of Cognitive Science, vol.17, issue.1, pp.27-62, 2016.

S. Garrod and M. J. Pickering, Why is conversation so easy?, Trends in cognitive sciences, vol.8, issue.1, pp.8-11, 2004.

K. Gerasymova and M. Spranger, An experiment in temporal language learning. Language Grounding in Robots, pp.237-254, 2012.

A. E. Goldberg, Constructions: A construction grammar approach to argument structure, 1995.

J. Gottlieb, M. Lopes, and P. Oudeyer, Motivated cognition: Neural and computational mechanisms of curiosity, attention, and intrinsic motivation, Recent Developments in Neuroscience Research on Human Motivation, pp.149-172, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01404468

D. Gouaillier, V. Hugel, P. Blazevic, C. Kilner, J. Monceaux et al., The nao humanoid: a combination of performance and affordability, 2008.

S. Graham, Theories and principles of motivation. Handbook of educational psychology, vol.4, pp.63-84, 1996.

R. Hall, Psychology world -cognitive dissonance, pp.25-34, 1998.

F. Harry, M. K. Harlow, D. R. Harlow, and . Meyer, Learning motivated by a manipulation drive, Journal of Experimental Psychology, vol.40, issue.2, p.228, 1950.

G. Harold, Essays in linguistics, 1957.

D. O. Hebb, Drives and the CNS (conceptual nervous system), Psychological review, vol.62, issue.4, p.243, 1955.

F. Hervouet, Exploration et structuration intrinsèquement motivées d'espaces d'apprentissage sensorimoteur: contributions théoriques, plateforme et expérimentations, 2014.

F. Hervouet and E. Bourreau, Fimo: Framework for intrinsic motivation, ECAL: European Conference on Artificial Life, pp.997-1004, 2013.
URL : https://hal.archives-ouvertes.fr/lirmm-01066395

M. Hild, T. Siedel, C. Benckendorff, C. Thiele, and M. Spranger, Myon, a new humanoid, Language grounding in robots, pp.25-44, 2012.

J. H. Holland, Echoing emergence: Objectives, rough definitions, and speculations for echo-class models, Complexity, pp.309-342, 1999.

P. Hopper, Emergent grammar, Annual Meeting of the Berkeley Linguistics Society, vol.13, pp.139-157, 1987.

C. L. Hull, Principles of behavior: an introduction to behavior theory, 1943.

J. M. Hunt, Intrinsic motivation and its role in psychological development, Nebraska symposium on motivation, vol.13, pp.189-282, 1965.

T. Ishida, Development of a small biped entertainment robot qrio, Micro-Nanomechatronics and Human Science, 2004 and The Fourth Symposium Micro-Nanomechatronics for Information-Based Society, pp.23-28, 2004.

E. Jablonka, M. J. Lamb, and A. Zeligowski, Evolution in four dimensions, revised edition: Genetic, epigenetic, behavioral, and symbolic variation in the history of life, 2014.

R. Jackendoff, Possible stages in the evolution of the language capacity, Trends in cognitive sciences, vol.3, issue.7, pp.272-279, 1999.

K. A. Jameson and N. Alvarado, Differences in color naming and color salience in vietnamese and english, Color Research & Application, vol.28, issue.2, pp.113-138, 2003.

Z. Jin-yu, C. Yan, and H. Xian-xiang, Edge detection of images based on improved sobel operator and genetic algorithms, IASP 2009. International Conference on, pp.31-35, 2009.

F. Kaplan and P. Oudeyer, The progress-drive hypothesis: an interpretation of early imitation. Models and mechanims of imitation and social learning: Behavioural, social and communication dimensions, pp.361-377, 2007.

P. Kay, Construction grammar. Words and the Grammar of Context, pp.123-131, 1997.

M. Keramati and B. Gutkin, Collecting reward to defend homeostasis: A homeostatic reinforcement learning theory. bioRxiv, p.5140, 2014.

C. Kidd, S. T. Piantadosi, and R. N. Aslin, The Goldilocks effect: Human infants allocate attention to visual sequences that are neither too simple nor too complex, PLOS ONE, vol.7, issue.5, p.36399, 2012.

E. Konig and J. Van-der-auwera, The germanic languages. Routledge, 2013.

M. G. Johan and . Lammens, A computational model of color perception and color naming, 1994.

C. Stephen, Levinson. Spatial language. Encyclopedia of cognitive science, vol.1, issue.1, pp.131-137, 2003.

H. Lin, M. R. Luo, L. W. Macdonald, and A. W. , Tarrant. A cross-cultural colour-naming study. part i: Using an unconstrained method, Color Research & Application, vol.26, issue.1, pp.40-60, 2001.

M. Loetzsch, P. Wellens, J. D. Beule, J. Bleys, and R. Van-trijp, The babel2 manual, 2008.

R. Maini and H. Aggarwal, Study and comparison of various image edge detection techniques, International journal of image processing (IJIP), vol.3, issue.1, pp.1-11, 2009.

K. Merrick and M. L. Maher, Motivated learning from interesting events: adaptive, multitask learning agents for complex environments, Adaptive Behavior, vol.17, issue.1, pp.7-27, 2009.

K. E. Merrick, Computational Models of Motivation for GamePlaying Agents, 2016.

J. L. Milford, J. L. Austin, and J. E. Smith, Community reinforcement and the dissemination of evidence-based practice: Implications for public policy, International Journal of Behavioral Consultation and Therapy, vol.3, issue.1, p.77, 2007.

M. Mirolli and G. Baldassarre, Functions and mechanisms of intrinsic motivations, Intrinsically Motivated Learning in Natural and Artificial Systems, pp.49-72, 2013.

A. Mojsilovic, A computational model for color naming and describing color composition of images, IEEE Transactions on Image Processing, vol.14, issue.5, pp.690-699, 2005.

K. C. Montgomery, The role of the exploratory drive in learning, Journal of Comparative and Physiological Psychology, vol.47, issue.1, p.60, 1954.

O. Moore and A. R. Anderson, Some principles for the design of clarifying educational environments. Handbook of socialization theory and research, 1968.

O. H. Mowrer and R. R. Lamoreaux, Avoidance conditioning and signal duration-a study of secondary motivation and reward, Psychological Monographs, vol.54, issue.5, 1942.

W. Henry and . Nissen, A study of exploratory behavior in the white rat by means of the obstruction method. The Pedagogical Seminary and, Journal of Genetic Psychology, vol.37, issue.3, pp.361-376, 1930.

S. Nolfi and M. Mirolli, Evolution of Communication and Language in Embodied Agents, 2010.

P. , Y. Oudeyer, and F. Kaplan, Discovering communication, Connection Science, vol.18, issue.2, pp.189-206, 2006.

P. , Y. Oudeyer, and F. Kaplan, What is intrinsic motivation? a typology of computational approaches, Frontiers in neurorobotics, vol.1, issue.6, 2009.

P. Oudeyer, F. Kaplan, and V. V. Hafner, Intrinsic motivation systems for autonomous mental development. Evolutionary Computation, IEEE Transactions on, vol.11, issue.2, pp.265-286, 2007.

S. Pauw, Size matters: Grounding quantifiers in spatial perception, 2013.

;. H. Ivan-petrovich-pavlov and . Milford, Conditional reflexes: An investigation of the physiological activity of the cerebral cortex, 1927.

R. R?dulescu, Simulating the shift towards semantic gender in dutch, 2015.

D. Roberson, J. Davidoff, R. L. Ian, L. R. Davies, and . Shapiro, The development of color categories in two languages: a longitudinal study, Journal of Experimental Psychology: General, vol.133, issue.4, p.554, 2004.

A. R. Robertson, The cie 1976 color-difference formulae, Color Research & Application, vol.2, issue.1, pp.7-11, 1977.

, Softbank Robotics. Pepper. Softbank Robotics, 2016.

E. H. Rosch, Natural categories, Cognitive psychology, vol.4, issue.3, pp.328-350, 1973.

M. Richard, E. L. Ryan, and . Deci, Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary educational psychology, vol.25, pp.54-67, 2000.

M. Richard, E. L. Ryan, and . Deci, A self-determination theory approach to psychotherapy: The motivational basis for effective change, Canadian Psychology/Psychologie canadienne, vol.49, issue.3, p.186, 2008.

O. V. Safuanova and N. N. Korzh, Anthropology of Color: Interdisciplinary multilevel modeling, p.55, 2007.

M. Schembri, M. Mirolli, and G. Baldassarre, Evolution and learning in an intrinsically motivated reinforcement learning robot, Advances in Artificial Life, pp.294-303, 2007.

M. Schembri, M. Mirolli, and G. Baldassarre, Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot, ICDL 2007. IEEE 6th International Conference on, pp.282-287, 2007.

J. Schmidhuber, Adaptive curiosity and adaptive confidence, 1991.

J. Schmidhuber, Curious model-building control systems, IEEE International Joint Conference on, pp.1458-1463, 1991.

J. Schmidhuber, Driven by compression progress: A simple principle explains essential aspects of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes. CoRR, 2008.

J. Schmidhuber, Formal theory of creativity, fun, and intrinsic motivation (1990-2010), IEEE Transactions on Autonomous Mental Development, vol.2, issue.3, pp.230-247, 2010.

W. Schueller and P. Oudeyer, Active control of complexity growth in naming games: Hearer's choice, EVOLANG 2016, 2016.

M. Schwob, Études sur l'argot français. Editions Allia, 1999.

J. Simpson and A. W. Tarrant, Sex-and age-related differences in colour vocabulary, Language and speech, vol.34, issue.1, pp.57-62, 1991.

S. Singh, A. G. Barto, and N. Chentanez, Intrinsically motivated reinforcement learning, Advances in neural information processing systems, pp.1281-1288, 2005.

S. Singh, R. L. Lewis, A. G. Barto, and J. Sorg, Intrinsically motivated reinforcement learning: An evolutionary perspective, IEEE Transactions on Autonomous Mental Development, vol.2, issue.2, pp.70-82, 2010.

K. Skaugen, The game changer, pp.29-37, 2015.

F. Burrhus and . Skinner, The Behavior of Organisms: An Experimental Analysis. The Century Psychology Series, 1938.

F. Burrhus and . Skinner, Science and human behavior. Free Pr, 1953.

K. Smith, S. Kirby, and H. Brighton, Iterated learning: A framework for the emergence of language, Artificial Life, vol.9, issue.4, pp.371-386, 2003.

L. B. Smith, S. S. Jones, and B. Landau, Naming in young children: A dumb attentional mechanism?, Cognition, vol.60, issue.2, pp.143-171, 1996.

C. , R. Spates, S. L. Pagoto, and A. Kalata, A qualitative and quantitative review of behavioral activation treatment of major depressive disorder, The Behavior Analyst Today, vol.7, issue.4, p.508, 2006.

K. W. Spence, Behavior theory and conditioning, 1956.

M. Spranger, Evolving grounded spatial language strategies, vol.27, pp.97-106, 2013.

M. Spranger, The evolution of grounded spatial language, 2016.

M. Spranger, M. Loetzsch, and S. Pauw, Open-ended grounded semantics, ECAI: European Conference on Artificial Intelligence, pp.929-934, 2010.

M. Spranger, S. Pauw, M. Loetzsch, and L. Steels, Openended procedural semantics, Language grounding in robots, pp.153-172, 2012.

M. Spranger, J. Suchan, M. Bhatt, and M. Eppe, Grounding dynamic spatial relations for embodied (robot) interaction, Pacific Rim International Conference on Artificial Intelligence, pp.958-971, 2014.

L. Steels, A self-organizing spatial vocabulary, Artificial life, vol.2, issue.3, pp.319-332, 1995.

L. Steels, Self-organizing vocabularies, Proceedings of Artificial Life V, pp.179-184, 1996.

L. Steels, The Talking Heads Experiment, Words and Meanings. Laboratorium, vol.1, 1999.

L. Steels, Language as a complex adaptive system, International Conference on Parallel Problem Solving from Nature, pp.17-26, 2000.

L. Steels, Evolving grounded communication for robots, Trends in cognitive sciences, vol.7, pp.308-312, 2003.

L. Steels, Language re-entrance and the 'inner voice', Journal of Consciousness Studies, vol.10, issue.4-5, pp.173-185, 2003.

L. Steels, The autotelic principle, Embodied Artificial Intelligence, vol.3139, pp.231-242, 2004.

L. Steels, The emergence and evolution of linguistic structure: from lexical to grammatical communication systems, Connection science, vol.17, issue.3-4, pp.213-230, 2005.

L. Steels, Regulating the growth of complexity in developmental systems, US Patent, vol.7, p.927, 2008.

L. Steels, Design patterns in fluid construction grammar, vol.11, 2011.

L. Steels, Computational issues in fluid construction grammar, Lecture Notes in Computer Science, vol.7249, 2012.

L. Steels, Experiments in Cultural Language Evolution, 2012.

L. Steels, Self-organization and selection in cultural language evolution, Experiments in Cultural Language Evolution. Amsterdam: John Benjamins, pp.1-40, 2012.

L. Steels, Agent-based models for the emergence and evolution of grammar, Philosophical Transactions of the Royal Society of London B: Biological Sciences, vol.371, 1701.

L. Steels, Basics of fluid construction grammar. Constructions and frames, 2016.

L. Steels and T. Belpaeme, Coordinating perceptually grounded categories through language: A case study for colour, Behavioral and brain sciences, vol.28, issue.4, pp.469-488, 2005.

L. Steels and J. Bleys, Planning what to say: Second order semantics for fluid construction grammars, Proceedings of caepia '05. Lecture notes in AI, 2005.

L. Steels and E. Garcia-casademont, How to play the syntax game, Proceedings of the European Conference on Artificial Life, pp.479-486, 2015.

L. Steels and M. Loetzsch, Babel: A tool for running experiments on the evolution of language, Evolution of Communication and Language in Embodied Agents, pp.307-313, 2010.

L. Steels and A. Mcintyre, Spatially distributed naming games. Advances in complex systems, vol.1, pp.301-323, 1998.

L. Steels and P. Wellens, Scaffolding language emergence using the autotelic principle, Artificial Life, 2007. ALIFE'07. IEEE Symposium on, pp.325-332, 2007.

J. Storck, S. Hochreiter, and J. Schmidhuber, Reinforcement driven information acquisition in non-deterministic environments, Proceedings of the international conference on artificial neural networks, vol.2, pp.159-164, 1995.

A. Stout and A. G. Barto, Competence progress intrinsic motivation, 2010 IEEE 9th International Conference on Development and Learning, pp.257-262, 2010.

A. Stout, G. D. Konidaris, and A. G. Barto, Intrinsically motivated reinforcement learning: A promising framework for developmental robot learning, 2005.

J. Sturges, T. W. , and A. Whitfield, Locating basic colours in the munsell space, Color Research & Application, vol.20, issue.6, pp.364-376, 1995.

R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction, vol.1, 1998.

J. C. Sweeney, D. Webb, T. Mazzarol, and G. N. Soutar, Self-determination theory and word of mouth about energy-saving behaviors: An online experiment, Psychology & Marketing, vol.31, issue.9, pp.698-716, 2014.

W. Van-den-broeck, Constraint-based compositional semantics, Proceedings of the 7th International Conference on the Evolution of Language, pp.338-345, 2008.

R. Van-trijp, The emergence of semantic roles in fluid construction grammar, The evolution of language. proceedings of the 7th international conference, pp.346-353, 2008.

. Remi-van-trijp, Fitness landscapes in cultural language evolution: a case study on german definite articles, Evolution of Language (Evolang-X), 2014.

B. D. Vylder and K. Tuyls, How to reach linguistic consensus: A proof of convergence for the naming game, Journal of Theoretical Biology, vol.242, issue.4, pp.818-831, 2006.

P. Wellens, Adaptive Strategies in the Emergence of Lexical Systems. phd, 2012.

P. Wellens, M. Loetzsch, and L. Steels, Flexible word meaning in embodied agents, Connection Science, vol.20, issue.2, pp.173-191, 2008.

R. W. White, Motivation reconsidered: the concept of competence, Psychological review, vol.66, issue.5, p.297, 1959.

C. William, J. R. Wimsatt, and . Griesemer, Reproducing entrenchments to scaffold culture: The central role of development in cultural evolution. Integrating evolution and development: From theory to practice, pp.227-323, 2007.

L. Wittgenstein, Philosophical Investigations. Basil Blackwell, Oxford, 1953.

P. Zackariasson and T. L. Wilson, Paradigm shifts in the video game industry, Competitiveness Review: An International Business Journal, vol.20, issue.2, pp.139-151, 2010.

R. A. Zwaan and G. A. Radvansky, Situation models in language comprehension and memory, Psychological bulletin, vol.123, issue.2, p.162, 1998.