O. Abdel-hamid, A. Mohamed, H. Jiang, L. Deng, G. Penn et al., Convolutional Neural Networks for Speech Recognition, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.22, issue.10, pp.1533-1545, 2014.
DOI : 10.1109/TASLP.2014.2339736

G. Alain and Y. Bengio, What regularized auto-encoders learn from the data-generating distribution, Journal of Machine Learning Research, vol.15, issue.1, pp.3563-3593, 2014.

D. Bahdanau and H. Jaeger, Smart decisions by small adjust-ments: Iterating denoising autoencoders, 2014.

P. Baldi and K. Hornik, Neural networks and principal component analysis: Learning from examples without local minima, Neural Networks, vol.2, issue.1, pp.53-58, 1989.
DOI : 10.1016/0893-6080(89)90014-2

V. Beaucousin, M. Cassotti, G. Simon, A. Pineau, M. Kostova et al., ERP evidence of a meaningfulness impact on visual global/local processing: When meaning captures attention, Neuropsychologia, vol.49, issue.5, pp.1258-1266, 2011.
DOI : 10.1016/j.neuropsychologia.2011.01.039

J. Normand, R. Beaudry, and . Renner, An intuitive proof of the data processing inequality. arXiv preprint, 2011.

R. Bellman, Dynamic Programming, 1957.

Y. Bengio and Y. Grandvalet, No unbiased estimator of the variance of k-fold cross-validation, Journal of machine learning research, vol.5, pp.1089-1105, 2004.

Y. Bengio, P. Simard, and P. Frasconi, Learning long-term dependencies with gradient descent is difficult, IEEE Transactions on Neural Networks, vol.5, issue.2, pp.157-166, 1994.
DOI : 10.1109/72.279181
URL : http://www.research.microsoft.com/~patrice/PDF/long_term.pdf

Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, Neural Probabilistic Language Models, Journal of machine learning research, vol.3, issue.Feb, pp.1137-1155, 2003.
DOI : 10.1007/3-540-33486-6_6
URL : https://hal.archives-ouvertes.fr/hal-01434258

Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, Greedy layer-wise training of deep networks, Advances in Neural Information Processing Systems 19, pp.153-160, 2007.

Y. Bengio, C. Aaron, P. Courville, and . Vincent, Unsupervised feature learning and deep learning: A review and new perspectives, 1206.

Y. Bengio, G. Mesnil, Y. Dauphin, and S. Rifai, Better mixing via deep representations, Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp.552-560, 2013.

Y. Bengio, L. Yao, G. Alain, and P. Vincent, Generalized denoising auto-encoders as generative models, Advances in Neural Information Processing Systems, pp.899-907, 2013.

J. Bergstra, N. Casagrande, D. Erhan, D. Eck, and B. Kégl, Aggregate features and ADABOOST for music classification, Machine Learning, vol.10, issue.5, pp.473-484, 2006.
DOI : 10.1007/s10994-006-9019-7
URL : https://hal.archives-ouvertes.fr/inria-00176062

G. David and B. , Aesthetic measure, 1933.

A. Margaret, E. A. Boden, and . Edmonds, What is generative art? Digital Creativity, pp.21-46, 2009.

R. Samuel, L. Bowman, O. Vilnis, . Vinyals, M. Andrew et al., Generating sentences from a continuous space, 2015.

A. Breton, Marcel duchamp : The bride stripped bare by her own bachelors, This Quarter « Surrealist Number », vol.5, issue.1, 1932.

O. Breuleux, Y. Bengio, and P. Vincent, Unlearning for better mixing, 2009.

R. Buchanan, Wicked problems in design thinking. Design issues, pp.5-21, 1992.
DOI : 10.2307/1511637

D. Burraston and E. Edmonds, Cellular automata in generative electronic music and sonic art: a historical and technical review, Digital Creativity, vol.22, issue.3, pp.165-185, 2005.
DOI : 10.1007/978-3-663-02723-2

J. Alex and . Champandard, Semantic style transfer and turning two-bit doodles into fine artworks. arXiv preprint, 2016.

X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever et al., Infogan: Interpretable representation learning by information maximizing generative adversarial nets, Advances in Neural Information Processing Systems, pp.2172-2180, 2016.

M. Cherti, B. Kégl, and A. Kazakç?, Out-of-Class Novelty Generation : An Experimental Foundation, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), 2016.
DOI : 10.1109/ICTAI.2017.00197
URL : https://hal.archives-ouvertes.fr/hal-01773776

M. Cherti, B. Kégl, and A. Kazakç?, De novo drug design with deep generative models: an empirical study, ICLR workshop, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01773760

K. Cho, Boltzmann machines and denoising autoencoders for image denoising . arXiv preprint, 2013.

K. Cho, B. Van-merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares et al., Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint, 2014.
DOI : 10.3115/v1/d14-1179
URL : https://hal.archives-ouvertes.fr/hal-01433235

F. Chollet, , 2015.

N. Chomsky, On certain formal properties of grammars, Information and Control, vol.2, issue.2, pp.137-167, 1959.
DOI : 10.1016/S0019-9958(59)90362-6

K. L. and C. , Markov chains, 1967.
DOI : 10.1007/978-3-642-62015-7

J. Clune and H. Lipson, Evolving three-dimensional objects with a generative encoding inspired by developmental biology, Proceedings of the European Conference on Artificial Life, pp.144-148, 2011.

G. Cohen, S. Afshar, J. Tapson, and A. Van-schaik, Emnist: an extension of mnist to handwritten letters, 2017.

R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu et al., Natural language processing (almost) from scratch, The Journal of Machine Learning Research, vol.12, pp.2493-2537, 2011.

J. Conway, The game of life, Scientific American, vol.223, issue.44, 1970.

M. Cook, Universality in elementary cellular automata Complex systems, pp.1-40, 2004.

M. Cook and S. Colton, Generating code for expressing simple preferences: Moving on from hardcoding and randomness, ICCC, pp.8-16, 2015.

E. George, D. Dahl, L. Yu, A. Deng, and . Acero, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. Audio, Speech, and Language Processing, IEEE Transactions on, vol.20, issue.1, pp.30-42, 2012.

R. Dahl, M. Norouzi, and J. Shlens, Pixel recursive super resolution . arXiv preprint, 2017.

R. Datta, D. Joshi, J. Li, Z. James, and . Wang, Studying Aesthetics in Photographic Images Using a Computational Approach, European Conference on Computer Vision, pp.288-301, 2006.
DOI : 10.1007/11744078_23

J. Deng, W. Dong, R. Socher, L. Li, K. Li et al., ImageNet: A large-scale hierarchical image database, 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp.248-255, 2009.
DOI : 10.1109/CVPR.2009.5206848

L. Emily, S. Denton, R. Chintala, and . Fergus, Deep generative image models using a laplacian pyramid of adversarial networks, Advances in Neural Information Processing Systems, pp.1486-1494, 2015.

L. Devroye, Sample-based non-uniform random variate generation, Proceedings of the 18th conference on Winter simulation , WSC '86, pp.260-265, 1986.
DOI : 10.1145/318242.318443

F. Dey and A. Caflisch, Fragment-Based de Novo Ligand Design by Multiobjective Evolutionary Optimization, Journal of Chemical Information and Modeling, vol.48, issue.3, pp.679-690, 2008.
DOI : 10.1021/ci700424b
URL : http://www.biochem-caflisch.unizh.ch/static/pdf/febdey08.pdf

J. Diedrich, M. Benedek, E. Jauk, C. Aljoscha, and . Neubauer, Are creative ideas novel and useful? Psychology of, Aesthetics, Creativity, and the Arts, vol.9, issue.1, p.35, 2015.
DOI : 10.1037/a0038688

P. Domingos, A few useful things to know about machine learning, Communications of the ACM, vol.55, issue.10, pp.78-87, 2012.
DOI : 10.1145/2347736.2347755
URL : http://homes.cs.washington.edu/~pedrod/papers/cacm12.pdf

C. Dong, C. C. Loy, K. He, and X. Tang, Image Super-Resolution Using Deep Convolutional Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.38, issue.2, 2014.
DOI : 10.1109/TPAMI.2015.2439281
URL : http://arxiv.org/pdf/1501.00092

A. Dosovitskiy and T. Brox, Generating images with perceptual similarity metrics based on deep networks, Advances in Neural Information Processing Systems, pp.658-666, 2016.

A. Dosovitskiy, J. Springenberg, M. Tatarchenko, and T. Brox, Learning to Generate Chairs, Tables and Cars with Convolutional Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016.
DOI : 10.1109/TPAMI.2016.2567384
URL : http://arxiv.org/pdf/1411.5928

D. Douguet, H. Munier-lehmann, G. Labesse, and S. Pochet, LEA3D: A Computer-Aided Ligand Design for Structure-Based Drug Design, Journal of Medicinal Chemistry, vol.48, issue.7, pp.2457-2468, 2005.
DOI : 10.1021/jm0492296
URL : https://hal.archives-ouvertes.fr/pasteur-00166207

V. Dumoulin and F. Visin, A guide to convolution arithmetic for deep learning. arXiv preprint, 2016.

R. Sean and . Eddy, Hidden markov models, Current opinion in structural biology, vol.6, issue.3, pp.361-365, 1996.

E. Edmonds, Independence of Rose's axioms for m-valued implication, The Journal of Symbolic Logic, vol.243, issue.02, pp.283-284, 1969.
DOI : 10.2307/2271105

P. Ertl and A. Schuffenhauer, Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions, Journal of Cheminformatics, vol.1, issue.1, p.8, 2009.
DOI : 10.1186/1758-2946-1-8

M. Farbood and B. Schöner, Analysis and synthesis of palestrina-style counterpoint using markov chains, ICMC, 2001.

G. Fauconnier and M. Turner, Blending as a central process of grammar, Conceptual structure, discourse, and language, p.130, 1996.

U. Fechner and G. Schneider, Flux (1):?? A Virtual Synthesis Scheme for Fragment-Based de Novo Design, Journal of Chemical Information and Modeling, vol.46, issue.2, pp.699-707, 2006.
DOI : 10.1021/ci0503560

T. William, . Freeman, R. Thouis, . Jones, C. Egon et al., Example-based superresolution, IEEE Computer graphics and Applications, vol.22, issue.2, pp.56-65, 2002.

P. Galanter, Generative art after computers,[in:] generative art?proceedings ga2012 xv generative art conference, 2012.

P. Galanter, Computational Aesthetic Evaluation: Past and Future, Computers and Creativity, pp.255-293, 2012.
DOI : 10.1007/978-3-642-31727-9_10

L. A. Gatys, A. S. Ecker, and M. Bethge, A Neural Algorithm of Artistic Style, Journal of Vision, vol.16, issue.12, 2015.
DOI : 10.1167/16.12.326
URL : https://doi.org/10.1167/16.12.326

A. Leon, . Gatys, S. Alexander, M. Ecker, and . Bethge, A neural algorithm of artistic style. arXiv preprint, 2015.

J. Gauci, O. Kenneth, and . Stanley, Autonomous Evolution of Topographic Regularities in Artificial Neural Networks, Neural Computation, vol.7, issue.7, pp.1860-1898, 2010.
DOI : 10.1109/5.784219
URL : http://eplex.cs.ucf.edu/papers/gauci_nc10.pdf

J. Gehring, M. Auli, D. Grangier, D. Yarats, N. Yann et al., Convolutional sequence to sequence learning, 2017.

M. Gell-mann, What is complexity? In Complexity and industrial clusters, pp.13-24, 2002.

Z. Ghahramani, Unsupervised Learning, Advanced lectures on machine learning, pp.72-112, 2004.
DOI : 10.1145/1015330.1015439

V. Gillet, P. Peter-johnson, S. Mata, P. Sike, and . Williams, SPROUT: A program for structure generation, Journal of Computer-Aided Molecular Design, vol.28, issue.2, pp.127-153, 1993.
DOI : 10.1007/978-3-662-09438-9

R. Gómez-bombarelli, J. Aguilera-iparraguirre, D. Timothy, D. Hirzel, D. Duvenaud et al., Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach, Nature Materials, vol.5, issue.10, pp.151120-1127, 2016.
DOI : 10.1021/ct9003004

R. Gómez-bombarelli, D. Duvenaud, J. Miguel-hernández-lobato, J. Aguilera-iparraguirre, D. Timothy et al., Automatic chemical design using a data-driven continuous representation of molecules. arXiv preprint, 2016.

I. Goodfellow, Nips 2016 tutorial: Generative adversarial networks. arXiv preprint, 2016.

I. Goodfellow, J. Pouget-abadie, M. Mirza, B. Xu, D. Warde-farley et al., Generative adversarial nets, Advances in Neural Information Processing Systems, pp.2672-2680, 2014.

R. Gary and . Greenfield, Co-evolutionary methods in evolutionary art. The Art of Artificial Evolution, pp.357-380, 2008.

K. Gregor, I. Danihelka, A. Mnih, C. Blundell, and D. Wierstra, Deep autoregressive networks. arXiv preprint, 2013.

A. Gretton, M. Karsten, . Borgwardt, J. Malte, B. Rasch et al., A kernel two-sample test, Journal of Machine Learning Research, vol.13, pp.723-773, 2012.

P. Grunwald and P. Vitányi, Shannon information and kolmogorov complexity . arXiv preprint cs, 2004.

C. Guckelsberger, C. Salge, and S. Colton, Addressing the " why? " in computational creativity: A non-anthropocentric, minimal model of intentional creative agency, 2017.

I. Gulrajani, K. Kumar, F. Ahmed, A. A. Taiga, F. Visin et al., Pixelvae: A latent variable model for natural images. arXiv preprint, 2016.

M. Hartenfeller and G. Schneider, design, Wiley Interdisciplinary Reviews: Computational Molecular Science, vol.3, issue.5, pp.742-759, 2011.
DOI : 10.4155/fmc.11.8

M. Hartenfeller, H. Zettl, M. Walter, M. Rupp, F. Reisen et al., DOGS: Reaction-Driven de novo Design of Bioactive Compounds, PLoS Computational Biology, vol.309, issue.2, p.1002380, 2012.
DOI : 10.1371/journal.pcbi.1002380.s001

W. Hatchuel, A new approach of innovative design: an introduction to ck theory, DS 31: Proceedings of ICED 03, the 14th International Conference on Engineering Design, 2003.

W. Hatchuel, Design as forcing: deepening the foundations of ck theory. Guidelines for a Decision Support Method Adapted to NPD Processes, 2007.

A. Hatchuel and B. Weil, Ck design theory: an advanced formulation, pp.181-192, 2009.
DOI : 10.1007/s00163-008-0043-4

A. Hatchuel, B. Weil, and P. L. Masson, Towards an ontology of design: lessons from C???K design theory and Forcing, Research in Engineering Design, vol.15, issue.3, pp.147-163, 2013.
DOI : 10.1016/S0736-5845(99)00029-0
URL : https://hal.archives-ouvertes.fr/hal-01485098

K. He, X. Zhang, S. Ren, and J. Sun, Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification, 2015 IEEE International Conference on Computer Vision (ICCV), pp.1026-1034, 2015.
DOI : 10.1109/ICCV.2015.123
URL : http://arxiv.org/pdf/1502.01852

E. Geoffrey and . Hinton, Distributed representations, 1984.

E. Geoffrey, . Hinton, R. Ruslan, and . Salakhutdinov, Reducing the dimensionality of data with neural networks, science, issue.5786, pp.313504-507, 2006.

E. Geoffrey, S. Hinton, Y. Osindero, and . Teh, A fast learning algorithm for deep belief nets, Neural computation, vol.18, issue.7, pp.1527-1554, 2006.

S. Hochreiter, The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol.06, issue.02, pp.107-116, 1998.
DOI : 10.1142/S0218488598000094

S. Hochreiter and J. Schmidhuber, Long Short-Term Memory, Neural Computation, vol.4, issue.8, pp.1735-1780, 1997.
DOI : 10.1016/0893-6080(88)90007-X

H. John and . Holland, Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence, 1992.

S. Holtzman, Using Generative Grammars for Music Composition, Computer Music Journal, vol.5, issue.1, pp.51-64, 1981.
DOI : 10.2307/3679694

, Proceedings of the International Conference on Computational Creativity, 2016.

J. John, T. Irwin, . Sterling, M. Michael, . Mysinger et al., Zinc: a free tool to discover chemistry for biology, Journal of chemical information and modeling, vol.52, issue.7, pp.1757-1768, 2012.

P. Isola, J. Zhu, T. Zhou, and A. A. Efros, Image-toimage translation with conditional adversarial networks, 2016.

E. Kyle and . Jennings, Developing creativity: Artificial barriers in artificial intelligence. Minds and Machines, pp.489-501, 2010.

Y. Jin, J. Zhang, M. Li, and Y. Tian, Huachun Zhu, and Zhihao Fang. Towards the automatic anime characters creation with generative adversarial networks, 2017.

N. Philip, How jazz musicians improvise Music Perception, An Interdisciplinary Journal, vol.19, issue.3, pp.415-442, 2002.

R. Donald, M. Jones, . Schonlau, J. William, and . Welch, Efficient global optimization of expensive black-box functions, Journal of Global optimization, vol.13, issue.4, pp.455-492, 1998.

N. Kalchbrenner, L. Espeholt, K. Simonyan, A. Van-den-oord, A. Graves et al., Neural machine translation in linear time, 2016.

H. Kamyshanska and R. Memisevic, On autoencoder scoring, Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp.720-728, 2013.

H. Kamyshanska and R. Memisevic, The Potential Energy of an Autoencoder, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.37, issue.6, pp.1261-1273, 2015.
DOI : 10.1109/TPAMI.2014.2362140
URL : http://www.iro.umontreal.ca/%7Ememisevr/pubs/AEenergy.pdf

A. Karpathy, J. Johnson, and L. Fei-fei, Visualizing and understanding recurrent networks. arXiv preprint, 2015.

A. Kazakç?, Conceptive artificial intelligence: Insights from design theory, International Design Conference DESIGN2014, pp.1-16, 2014.

A. Kazakç?, M. Cherti, and B. Kégl, Digits that are not: Generating new types through deep neural nets, Proceedings of the Seventh International Conference on Computational Creativity, 2016.

O. Ak?n and . Kazakç?, On the imaginative constructivist nature of design: a theoretical approach, pp.127-145, 2013.

A. Osman and K. , La théorie CKE comme fondement théorique pour les assistants de conception: DesigNAR, un assistant de synthèse de concept basé sur la théorie CKE, 2007.

. Kazakci, . Akin, A. Hatchuel, L. Masson, . Pascal et al., Simulation of design reasoning based on ck theory: a model and an example application, DS 60: Proceedings of DESIGN 2010, the 11th International Design Conference, 2010.

B. Kégl, Intrinsic dimension estimation using packing numbers, Advances in neural information processing systems, pp.697-704, 2003.

Y. Kim, Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408, 2014.
DOI : 10.3115/v1/d14-1181
URL : https://doi.org/10.3115/v1/d14-1181

P. Diederik, M. Kingma, and . Welling, Auto-encoding variational bayes. arXiv preprint, 2013.

P. Diederik, S. Kingma, D. Mohamed, M. Jimenez-rezende, and . Welling, Semi-supervised learning with deep generative models, Advances in Neural Information Processing Systems, pp.3581-3589, 2014.

A. Mark and . Kramer, Nonlinear principal component analysis using autoassociative neural networks, AIChE journal, vol.37, issue.2, pp.233-243, 1991.

J. Robert and . Krawczyk, Architectural interpretation of cellular automata, The 5th International Conference on Generative Art, pp.7-8, 2002.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Advances in neural information processing systems, pp.1097-1105, 2012.
DOI : 10.1162/neco.2009.10-08-881
URL : http://dl.acm.org/ft_gateway.cfm?id=3065386&type=pdf

W. Charles and . Krueger, Software reuse, ACM Computing Surveys (CSUR), vol.24, issue.2, pp.131-183, 1992.

S. Peter, . Kutchukian, I. Eugene, and . Shakhnovich, De novo design: balancing novelty and confined chemical space, Expert opinion on drug discovery, vol.5, issue.8, pp.789-812, 2010.

M. Brenden, R. Lake, J. B. Salakhutdinov, and . Tenenbaum, Humanlevel concept learning through probabilistic program induction, Science, vol.350, issue.6266, pp.1332-1338, 2015.

M. Brenden, . Lake, D. Tomer, J. B. Ullman, . Tenenbaum et al., Building machines that learn and think like people, Behavioral and Brain Sciences, vol.40, 2017.

M. Alex, A. Lamb, A. Goyal, Y. Parth-goyal, S. Zhang et al., Professor forcing: A new algorithm for training recurrent networks, Advances In Neural Information Processing Systems, pp.4601-4609, 2016.

G. Landrum, Rdkit: Open-source cheminformatics. Online) http://www. rdkit. org, Accessed, vol.3, issue.04, p.2012, 2006.

H. Larochelle and I. Murray, The neural autoregressive distribution estimator, AISTATS, 2011.

Y. Lecun and C. Cortes,

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE, vol.86, issue.11, pp.2278-2324, 1998.
DOI : 10.1109/5.726791

Y. Lecun, Y. Bengio, and G. Hinton, Deep learning, Nature, vol.9, issue.7553, pp.436-444
DOI : 10.1007/s10994-013-5335-x

C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Aitken et al., Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint, 2016.

H. Lee, A. Battle, R. Raina, Y. Andrew, and . Ng, Efficient sparse coding algorithms, Advances in neural information processing systems, pp.801-808, 2007.

H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pp.609-616, 2009.
DOI : 10.1145/1553374.1553453

J. Lehman, O. Kenneth, and . Stanley, Abandoning Objectives: Evolution Through the Search for Novelty Alone, Evolutionary Computation, vol.7, issue.3, pp.189-223, 2011.
DOI : 10.1016/0165-6074(93)90215-7

J. Lehman, O. Kenneth, and . Stanley, Novelty Search and the Problem with Objectives, Genetic Programming Theory and Practice IX, pp.37-56, 2011.
DOI : 10.1007/978-1-4614-1770-5_3

Y. Li, Y. Zhao, Z. Liu, and R. Wang, Automatic Tailoring and Transplanting: A Practical Method that Makes Virtual Screening More Useful, Journal of Chemical Information and Modeling, vol.51, issue.6, 2011.
DOI : 10.1021/ci200036m

Y. Li, Z. Zhao, Z. Liu, M. Su, and R. Wang, AutoT&T v.2: An Efficient and Versatile Tool for Lead Structure Generation and Optimization, Journal of Chemical Information and Modeling, vol.56, issue.2, pp.435-453, 2016.
DOI : 10.1021/acs.jcim.5b00691

Y. Li, N. Wang, J. Liu, and X. Hou, Demystifying neural style transfer. arXiv preprint, 2017.

A. Liapis, H. Perez-martínez, J. Togelius, N. Georgios, and . Yannakakis, Transforming exploratory creativity with delenox, ICCC, pp.56-63, 2013.

S. Lienhard, C. Lau, P. Müller, P. Wonka, and M. Pauly, Design Transformations for Rule-based Procedural Modeling, Computer Graphics Forum, vol.36, issue.2, pp.39-48, 2017.
DOI : 10.1007/978-3-0348-6879-2

J. Long, E. Shelhamer, and T. Darrell, Fully convolutional networks for semantic segmentation, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.3431-3440, 2015.
DOI : 10.1109/CVPR.2015.7298965

R. Loughran and M. Neill, Application domains considered in computational creativity, 2017.

L. Maaløe, C. K. Sønderby, . Søren-kaae, O. Sønderby, and . Winther, Auxiliary deep generative models. arXiv preprint, 2016.

P. Machado and H. Amaro, Fitness functions for ant colony paintings, ICCC, pp.32-39

P. Machado and A. Cardoso, All the truth about nevar, Applied Intelligence, vol.16, issue.2, pp.101-118, 2002.
DOI : 10.1023/A:1013662402341

P. Machado, J. Romero, M. L. Santos, A. Cardoso, and B. Manaris, Adaptive Critics for Evolutionary Artists, Workshops on Applications of Evolutionary Computation, pp.437-446, 2004.
DOI : 10.1007/978-3-540-24653-4_45

P. Machado, J. Romero, and B. Manaris, Experiments in Computational Aesthetics, The art of artificial evolution, pp.381-415, 2008.
DOI : 10.1007/978-3-540-72877-1_18

J. Mairal, F. Bach, J. Ponce, and G. Sapiro, Online dictionary learning for sparse coding, Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pp.689-696, 2009.
DOI : 10.1145/1553374.1553463
URL : http://www.ima.umn.edu/preprints/apr2009/2249.pdf

A. Makhzani and B. Frey, k-sparse autoencoders. arXiv preprint, 2013.

A. Makhzani, J. Brendan, and . Frey, Winner-take-all autoencoders, Advances in Neural Information Processing Systems, pp.2773-2781, 2015.

B. Manaris, D. Vaughan, C. Wagner, J. Romero, and R. Davis, Evolutionary Music and the Zipf-Mandelbrot Law: Developing Fitness Functions for Pleasant Music, EvoWorkshops, pp.522-534, 2003.
DOI : 10.1007/3-540-36605-9_48
URL : http://www.cs.cofc.edu/~manaris/publications/EvoMUSART2003.final.pdf

B. Manaris, J. Romero, P. Machado, D. Krehbiel, T. Hirzel et al., Zipf's Law, Music Classification, and Aesthetics, Computer Music Journal, vol.20, issue.2, pp.55-69, 2005.
DOI : 10.1073/pnas.090504197

B. Brian, . Masek, S. David, . Baker, J. Roman et al., Multistep reaction based de novo drug design: Generating synthetically feasible design ideas, Journal of chemical information and modeling, vol.56, issue.4, pp.605-620, 2016.

J. Mccormack, Grammar based music composition Complex systems, pp.321-336, 1996.

J. Mccormack, Aesthetics, Art, Evolution, 2013.
DOI : 10.1007/978-3-642-36955-1_1

J. Mccormack and O. Bown, Life's what you make: Niche construction and evolutionary art. Applications of Evolutionary Computing, pp.528-537, 2009.

J. Mccormack, O. Bown, A. Dorin, J. Mccabe, G. Monro et al., Ten Questions Concerning Generative Computer Art, Leonardo, vol.6, issue.4, pp.135-141, 2014.
DOI : 10.1017/S1358246100007335

T. Mikolov, I. Sutskever, K. Chen, S. Greg, J. Corrado et al., Distributed representations of words and phrases and their compositionality, Advances in neural information processing systems, pp.3111-3119, 2013.

M. Mirza and S. Osindero, Conditional generative adversarial nets. arXiv preprint, 2014.

J. Mo?kus, On bayesian methods for seeking the extremum, Optimization Techniques IFIP Technical Conference, pp.400-404, 1975.

A. Moles, Information theory and esthetic perception, 0200.

A. Mordvintsev, C. Olah, and M. Tyka, Inceptionism: Going deeper into neural networks, Google Research Blog, 2015.

J. Mouret and S. Doncieux, Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study, Evolutionary Computation, vol.341, issue.1, pp.91-133, 2012.
DOI : 10.1016/0020-0190(92)90136-J
URL : https://hal.archives-ouvertes.fr/hal-00687609

, Georg Nees. Generative Computergraphik. Siemens AG, 1969.

G. Craig, . Nevill-manning, H. Ian, . Witten, L. David et al., Compression by induction of hierarchical grammars, Data Compression Conference DCC'94. Proceedings, pp.244-253, 1994.

A. Ng, Sparse autoencoder. CS294A Lecture notes, pp.1-19, 2011.

A. Nguyen, J. Yosinski, and J. Clune, Deep neural networks are easily fooled: High confidence predictions for unrecognizable images, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.427-436, 2015.
DOI : 10.1109/CVPR.2015.7298640
URL : http://yosinski.com/media/papers/Nguyen__2014__arXiv__Deep_Neural_Networks_are_Easily_Fooled.pdf

A. Nguyen, A. Dosovitskiy, J. Yosinski, T. Brox, and J. Clune, Synthesizing the preferred inputs for neurons in neural networks via deep generator networks, Advances in Neural Information Processing Systems, pp.3387-3395, 2016.

A. Nguyen, J. Yosinski, Y. Bengio, A. Dosovitskiy, and J. Clune, Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
DOI : 10.1109/CVPR.2017.374
URL : http://arxiv.org/pdf/1612.00005

A. Nguyen, J. Yosinski, and J. Clune, Multifaceted feature visualization: Uncovering the different types of features learned by each neuron in deep neural networks, 2016.

A. Mai-nguyen, J. Yosinski, and J. Clune, Innovation Engines, Proceedings of the 2015 on Genetic and Evolutionary Computation Conference, GECCO '15, pp.959-966, 2015.
DOI : 10.1145/2001576.2001707

A. Michael and . Nielsen, Neural networks and deep learning, 2015.

A. Odena, C. Olah, and J. Shlens, Conditional image synthesis with auxiliary classifier gans. arXiv preprint, 2016.

C. Olah, A. Mordvintsev, and L. Schubert, Feature Visualization, Distill, vol.2, issue.11
DOI : 10.23915/distill.00007

C. Olah, Understanding lstm networks, GITHUB blog, 2015.

A. Bruno, . Olshausen, J. David, and . Field, Sparse coding with an overcomplete basis set: A strategy employed by v1? Vision research, pp.3311-3325, 1997.

A. Van-den-oord, N. Kalchbrenner, and K. Kavukcuoglu, Pixel recurrent neural networks. arXiv preprint, 2016.

F. Pachet, Musical Virtuosity and Creativity, Computers and creativity, pp.115-146, 2012.
DOI : 10.1007/978-3-642-31727-9_5

F. Pachet and P. Roy, Markov constraints: steerable generation of Markov sequences, Constraints, vol.37, issue.4, pp.148-172, 2011.
DOI : 10.1109/18.87000

J. Parikka, Leonardo book review: The art of artificial evolution: A handbook on evolutionary art and music, 2008.

I. Yoav, P. Parish, and . Müller, Procedural modeling of cities, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pp.301-308, 2001.

R. Pascanu, T. Mikolov, and Y. Bengio, Understanding the exploding gradient problem. CoRR, abs, 1211.

J. Pennington, R. Socher, D. Christopher, and . Manning, Glove: Global Vectors for Word Representation, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.1532-1543, 2014.
DOI : 10.3115/v1/D14-1162

C. Albert, G. Pierce, . Rao, W. Guy, and . Bemis, Breed: Generating novel inhibitors through hybridization of known ligands. application to cdk2, p38, and hiv protease, Journal of medicinal chemistry, issue.11, pp.472768-2775, 2004.

P. Prusinkiewicz and A. Lindenmayer, The algorithmic beauty of plants, 2012.
DOI : 10.1007/978-1-4613-8476-2

A. Radford, L. Metz, and S. Chintala, Unsupervised representation learning with deep convolutional generative adversarial networks, 2015.

A. Rasmus, M. Berglund, M. Honkala, H. Valpola, and T. Raiko, Semi-supervised learning with ladder networks, Advances in Neural Information Processing Systems, pp.3532-3540, 2015.

E. Scott, Z. Reed, S. Akata, S. Mohan, B. Tenka et al., Learning what and where to draw, Advances In Neural Information Processing Systems, pp.217-225, 2016.

Y. Reich, A critical review of General Design Theory, Research in Engineering Design, vol.5, issue.1, pp.1-18, 1995.
DOI : 10.1007/978-3-642-72945-4_18
URL : http://or.eng.tau.ac.il:7777/gdti3-red.ps.Z

K. Shaoqing-ren, R. He, J. Girshick, and . Sun, Faster r-cnn: Towards real-time object detection with region proposal networks, Advances in neural information processing systems, pp.91-99, 2015.

D. Jimenez-rezende, S. Mohamed, I. Danihelka, K. Gregor, and D. Wierstra, One-shot generalization in deep generative models, ICML, 2016.

S. Rifai, P. Vincent, X. Muller, X. Glorot, and Y. Bengio, Contractive auto-encoders: Explicit invariance during feature extraction, Proceedings of the 28th international conference on machine learning (ICML- 11), pp.833-840, 2011.

W. Horst, . Rittel, M. Melvin, and . Webber, Dilemmas in a general theory of planning, Policy sciences, vol.4, issue.2, pp.155-169, 1973.

E. David, . Rumelhart, E. Geoffrey, R. J. Hinton, and . Williams, Learning representations by back-propagating errors, NATURE, vol.323, issue.9, 1986.

A. Mark, . Runco, J. Garrett, and . Jaeger, The standard definition of creativity, Creativity Research Journal, vol.24, issue.1, pp.92-96, 2012.

R. Salakhutdinov, E. Geoffrey, and . Hinton, Deep boltzmann machines, International Conference on Artificial Intelligence and Statistics, pp.448-455, 2009.

T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford et al., Improved techniques for training GANs, 2016.

D. Scherer, A. Müller, and S. Behnke, Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition, Artificial Neural Networks?ICANN 2010, pp.92-101, 2010.
DOI : 10.1007/978-3-642-15825-4_10
URL : http://www.ais.uni-bonn.de/papers/icann2010_maxpool.pdf

J. Schmidhuber, Driven by Compression Progress, pp.48-76
DOI : 10.1007/978-3-540-85563-7_2

J. Schmidhuber, Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990???2010), IEEE Transactions on Autonomous Mental Development, vol.2, issue.3, pp.230-247, 1990.
DOI : 10.1109/TAMD.2010.2056368

G. Schneider, De novo design?hop (p) ing against hope. Drug Discovery Today: Technologies, pp.453-460, 2013.
DOI : 10.1016/j.ddtec.2012.06.001

P. Schneider and G. Schneider, De Novo Design at the Edge of Chaos, Journal of Medicinal Chemistry, vol.59, issue.9, pp.4077-4086, 2016.
DOI : 10.1021/acs.jmedchem.5b01849

F. Schroff, D. Kalenichenko, and J. Philbin, FaceNet: A unified embedding for face recognition and clustering, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.815-823, 2015.
DOI : 10.1109/CVPR.2015.7298682
URL : http://arxiv.org/pdf/1503.03832

J. Secretan, N. Beato, D. B. Ambrosio, A. Rodriguez, A. Campbell et al., Picbreeder, Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems , CHI '08, pp.1759-1768, 2008.
DOI : 10.1145/1357054.1357328

H. Marwin, T. Segler, C. Kogej, . Tyrchan, P. Mark et al., Generating focussed molecule libraries for drug discovery with recurrent neural networks, 2017.

E. Claude and . Shannon, A mathematical theory of communication, part i, part ii, Bell Syst. Tech. J, vol.27, pp.623-656, 1948.

E. Claude and . Shannon, Coding theorems for a discrete source with a fidelity criterion, IRE Nat. Conv. Rec, vol.4, issue.1, pp.142-163, 1959.

A. Sharif-razavian, H. Azizpour, J. Sullivan, and S. Carlsson, Cnn features off-the-shelf: an astounding baseline for recognition, Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp.806-813, 2014.

A. Herbert and . Simon, The sciences of the artificial, 1969.

K. Sims, Artificial evolution for computer graphics, 0204.
DOI : 10.1145/127719.122752
URL : http://www2.hawaii.edu/~nreed/ics606/papers/Sims91p319graphics.pdf

K. Sims, Evolving virtual creatures, Proceedings of the 21st annual conference on Computer graphics and interactive techniques , SIGGRAPH '94, pp.15-22, 1994.
DOI : 10.1145/192161.192167
URL : http://www2.hawaii.edu/~nreed/ics606/papers/Sims94VirtualCreatures.pdf

O. Kenneth and . Stanley, Compositional pattern producing networks: A novel abstraction of development. Genetic programming and evolvable machines, pp.131-162, 2007.

O. Kenneth, R. Stanley, and . Miikkulainen, Efficient evolution of neural network topologies, Evolutionary Computation Proceedings of the 2002 Congress on, pp.1757-1762, 2002.

T. Sterling, J. John, and . Irwin, ZINC 15 ??? Ligand Discovery for Everyone, Journal of Chemical Information and Modeling, vol.55, issue.11, 2015.
DOI : 10.1021/acs.jcim.5b00559
URL : https://doi.org/10.1021/acs.jcim.5b00559

I. Sutskever, O. Vinyals, V. Quoc, and . Le, Sequence to sequence learning with neural networks, Advances in neural information processing systems, pp.3104-3112, 2014.

Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, DeepFace: Closing the Gap to Human-Level Performance in Face Verification, 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp.1701-1708, 2014.
DOI : 10.1109/CVPR.2014.220

H. Takagi, Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation, Proceedings of the IEEE, pp.1275-1296, 2001.
DOI : 10.1109/5.949485

H. Takeda, P. Veerkamp, and H. Yoshikawa, Modeling design process . AI magazine, p.37, 1990.

R. Taylor, Chaos, fractals, nature: a new look at jackson pollock, Eugine: Fractal Research, vol.170, p.229, 2006.

L. Stephen and . Thaler, The emerging intelligence and its critical look at us, Journal of Near-Death Studies, vol.17, issue.1, pp.21-29, 1998.

L. Theis and M. Bethge, Generative image modeling using spatial LSTMs, Advances in Neural Information Processing Systems, 1918.

L. Theis, A. Van-den-oord, and M. Bethge, A note on the evaluation of generative models, 2015.

M. Thoma, On-line recognition of handwritten mathematical symbols. arXiv preprint, 2015.

M. Peter and . Todd, A connectionist approach to algorithmic composition, Computer Music Journal, vol.13, issue.4, pp.27-43, 1989.

M. Peter and . Todd, A connectionist system for exploring melody space, Proceedings of the International Computer Music Conference, pp.65-65, 1992.

S. Todd and W. Latham, Mutator: a subjective human interface for evolution of computer sculptures. IBM United Kingdom Scientific Centre, 1991.

J. Togelius, N. Georgios, . Yannakakis, O. Kenneth, C. Stanley et al., Search-Based Procedural Content Generation: A Taxonomy and Survey, IEEE Transactions on Computational Intelligence and AI in Games, vol.3, issue.3, pp.172-186, 2011.
DOI : 10.1109/TCIAIG.2011.2148116
URL : http://julian.togelius.com/Togelius2011Searchbased.pdf

A. Toshev and C. Szegedy, DeepPose: Human Pose Estimation via Deep Neural Networks, 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp.1653-1660, 2014.
DOI : 10.1109/CVPR.2014.214
URL : http://arxiv.org/pdf/1312.4659

A. Van-den-oord, N. Kalchbrenner, and L. Espeholt, Alex Graves, et al. Conditional image generation with pixelcnn decoders, Advances in Neural Information Processing Systems, pp.4790-4798, 2016.

L. Van-der-maaten and G. Hinton, Visualizing data using t-SNE, The Journal of Machine Learning Research, vol.9, pp.2579-260585, 2008.

A. Van, D. Merwe, and W. Schulze, Music generation with markov models, IEEE MultiMedia, vol.18, issue.3, pp.78-85, 2011.

D. Ventura, Mere generation: Essential barometer or dated concept, Proceedings of the Seventh International Conference on Computational Creativity, ICCC, 2016.

P. Vincent, H. Larochelle, Y. Bengio, and P. Manzagol, Extracting and composing robust features with denoising autoencoders, Proceedings of the 25th international conference on Machine learning, ICML '08, pp.1096-1103, 2008.
DOI : 10.1145/1390156.1390294
URL : http://www.iro.umontreal.ca/~vincentp/Publications/denoising_autoencoders_tr1316.pdf

P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. Manzagol, Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, The Journal of Machine Learning Research, vol.11, pp.3371-3408, 2010.

E. V. Hippel, Lead Users: A Source of Novel Product Concepts, Management Science, vol.32, issue.7, pp.791-805, 1986.
DOI : 10.1287/mnsc.32.7.791

Q. Wang, P. Spronck, and R. Tracht, An overview of genetic algorithms applied to control engineering problems, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693), pp.1651-1656, 2003.
DOI : 10.1109/ICMLC.2003.1259761

R. Wang, Y. Gao, and L. Lai, LigBuilder: A Multi-Purpose Program for Structure-Based Drug Design, Journal of Molecular Modeling, vol.6, issue.7-8, pp.498-516, 2000.
DOI : 10.1007/s0089400060498

Z. Wang, R. Hamid, A. C. Sheikh, and . Bovik, No-reference perceptual quality assessment of jpeg compressed images, Image Processing. 2002. Proceedings . 2002 International Conference on, 2002.

Z. Wang, A. C. Bovik, R. Hamid, . Sheikh, P. Eero et al., Image Quality Assessment: From Error Visibility to Structural Similarity, IEEE Transactions on Image Processing, vol.13, issue.4, pp.600-612, 2004.
DOI : 10.1109/TIP.2003.819861
URL : http://www.cns.nyu.edu/~zwang/files/papers/ssim.pdf

D. Weininger, SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules, Journal of Chemical Information and Modeling, vol.28, issue.1, pp.31-36, 1988.
DOI : 10.1021/ci00057a005

J. Paul and . Werbos, Backpropagation through time: what it does and how to do it, Proceedings of the IEEE, pp.1550-1560, 1990.

D. White, C. Richard, and . Wilson, Generative Models for Chemical Structures, Journal of Chemical Information and Modeling, vol.50, issue.7, pp.1257-1274, 2010.
DOI : 10.1021/ci9004089

T. Wiegand and H. Schwarz, Source Coding: Part I of Fundamentals of Source and Video Coding, Foundations and Trends?? in Signal Processing, vol.4, issue.1-2, p.222, 2011.
DOI : 10.1561/2000000010

A. Geraint and . Wiggins, A preliminary framework for description, analysis and comparison of creative systems, Knowledge-Based Systems, vol.19, issue.7, pp.449-458, 2006.

A. Scott, . Wildman, M. Gordon, and . Crippen, Prediction of physicochemical parameters by atomic contributions, Journal of chemical information and computer sciences, vol.39, issue.5, pp.868-873, 1999.

J. Ronald, D. Williams, and . Zipser, A learning algorithm for continually running fully recurrent neural networks, Neural computation, vol.1, issue.2, pp.270-280, 1989.

S. Wold, K. Esbensen, and P. Geladi, Principal component analysis. Chemometrics and intelligent laboratory systems, pp.37-52, 1987.

S. Wolfram, Cellular Automata and Complexity, Computers in Physics, vol.9, issue.1, 1994.
DOI : 10.1063/1.4823369

P. Worth and S. Stepney, Growing music: musical interpretations of lsystems, Workshops on Applications of Evolutionary Computation, pp.545-550, 2005.
DOI : 10.1007/978-3-540-32003-6_56

J. Xiao, J. Hays, A. Krista, A. Ehinger, A. Oliva et al., SUN database: Large-scale scene recognition from abbey to zoo, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp.3485-3492, 2010.
DOI : 10.1109/CVPR.2010.5539970
URL : http://cs.brown.edu/~hays/papers/sun.pdf

J. Xie, L. Xu, and E. Chen, Image denoising and inpainting with deep neural networks, Advances in Neural Information Processing Systems, pp.341-349, 2012.

K. Xu, J. Ba, R. Kiros, K. Cho, and A. Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. Show, attend and tell: Neural image caption generation with visual attention, International Conference on Machine Learning, pp.2048-2057, 2015.

R. Yeh, C. Chen, T. Y. Lim, M. Hasegawa-johnson, N. Minh et al., Semantic image inpainting with perceptual and contextual losses, 2016.

H. Yoshikawa, General design theory and a cad system. Man-Machine communication in CAD, 1981.

J. Yosinski, J. Clune, A. Nguyen, T. Fuchs, and H. Lipson, Understanding neural networks through deep visualization, 2015.

D. Matthew and . Zeiler, Adadelta: an adaptive learning rate method. arXiv preprint, 2012.

H. Zhang, T. Xu, H. Li, S. Zhang, X. Huang et al., StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks, 2017 IEEE International Conference on Computer Vision (ICCV), 2016.
DOI : 10.1109/ICCV.2017.629
URL : http://arxiv.org/pdf/1612.03242

X. Zhang, J. Zhao, and Y. Lecun, Character-level convolutional networks for text classification, Advances in neural information processing systems, pp.649-657, 2015.

Y. Zhang, M. Ozay, Z. Sun, and T. Okatani, Information potential auto-encoders. arXiv preprint, 2017.

J. Zhu, P. Krähenbühl, E. Shechtman, and A. A. Efros, Generative Visual Manipulation on the Natural Image Manifold, European Conference on Computer Vision, pp.597-613, 2016.
DOI : 10.1109/CVPR.2013.299
URL : http://arxiv.org/pdf/1609.03552

J. Zhu, T. Park, P. Isola, and A. A. Efros, Unpaired image-toimage translation using cycle-consistent adversarial networks, 2017.
DOI : 10.1109/iccv.2017.244
URL : http://arxiv.org/pdf/1703.10593