D. Abramson, B. Bethwaite, C. Enticott, S. Garic, and T. Peachey, Parameter Exploration in Science and Engineering Using Many-Task Computing, IEEE Transactions on Parallel and Distributed Systems, vol.22, issue.6, pp.960-973, 2011.
DOI : 10.1109/TPDS.2010.177

M. J. Adams, A. H. Ter-hofstede, and M. L. Rosa, Open Source Software for Workflow Management: The Case of YAWL, IEEE Software, vol.28, issue.3, pp.16-19, 2011.
DOI : 10.1109/MS.2011.58

R. Agrawal, D. Gunopulos, and F. Leymann, Mining process models from workflow logs, Proceedings of the 6th International Conference on Extending Database Technology: Advances in Database Technology, EDBT '98, pp.469-483, 1998.
DOI : 10.1007/BFb0101003

B. Aiken, V. Bahl, B. Bhattacharjee, and B. Braden, Report of NSF workshop on network research testbeds, CISE) Advanced Networking Infrastructure & Research Division, 2002.

J. Albrecht, R. Braud, D. Dao, N. Topilski, C. Tuttle et al., Remote control: distributed application configuration, management, and visualization with Plush, Proceedings of the 21st conference on Large Installation System Administration Conference, LISA'07, pp.1-1519, 2007.

J. Albrecht, C. Tuttle, R. Braud, D. Dao, N. Topilski et al., Distributed application configuration, management, and visualization with plush, ACM Transactions on Internet Technology, vol.11, issue.2, pp.1-6, 2011.
DOI : 10.1145/2049656.2049658

J. Albrecht, C. Tuttle, A. C. Snoeren, and A. Vahdat, Loose synchronization for large-scale networked systems, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, ATEC '06, pp.28-28, 2006.

J. Albrecht, C. Tuttle, A. C. Snoeren, and A. Vahdat, PlanetLab application management using plush, ACM SIGOPS Operating Systems Review, vol.40, issue.1, pp.33-40, 2006.
DOI : 10.1145/1113361.1113370

J. R. Albrecht, Bringing big systems to small schools: distributed systems for undergraduates, Proceedings of the 40th ACM technical symposium on Computer science education, SIGCSE '09, pp.101-105, 2009.

M. David-allen, A. Chapman, B. Blaustein, and L. Mak, What do we do now? Workflows for an unpredictable world, Future Generation Computer Systems, vol.42, issue.0, pp.1-10, 2015.
DOI : 10.1016/j.future.2014.08.004

A. I. Avetisyan, R. Campbell, I. Gupta, M. T. Heath, S. Y. Ko et al., Open Cirrus: A Global Cloud Computing Testbed, Maciej Malawski, and Rafael Ferreira da Silva. Introducing PRECIP: An API for Managing Repeatable Experiments in the Cloud, pp.35-43, 2010.
DOI : 10.1109/MC.2010.111

M. Bardac, R. Deaconescu, and A. M. Florea, Scaling Peerto-Peer testing using Linux Containers, 9th RoEduNet International Conference, pp.287-292, 2010.

S. Roger, L. A. Barga, and . Digiampietri, Automatic capture and efficient storage of e-Science experiment provenance. Concurrency and Computation: Practice and Experience, pp.419-429, 2008.

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris et al., Xen and the Art of Virtualization, Proceedings of the 19th ACM Symposium on Operating Systems Principles , SOSP '03, pp.164-177, 2003.

A. Barker and J. Hemert, Scientific Workflow: A Survey and Research Directions, Parallel Processing and Applied Mathematics, pp.746-753, 2008.
DOI : 10.1007/978-3-540-68111-3_78

A. Basu, S. Fleming, J. Stanier, S. Naicken, I. Wakeman et al., The state of peer-to-peer network simulators, ACM Computing Surveys, vol.45, issue.4
DOI : 10.1145/2501654.2501660

A. Bavier, N. Feamster, M. Huang, L. Peterson, and J. Rexford, In VINI veritas, VINI Veritas: Realistic and Controlled Network Experimentation. SIGCOMM Comput, pp.3-14, 2006.
DOI : 10.1145/1151659.1159916

L. Bavoil, S. P. Callahan, C. E. Scheidegger, H. T. Vo, P. Crossno et al., VisTrails: Enabling Interactive Multiple-View Visualizations, IEEE Visualization, p.18, 2005.
DOI : 10.1109/vis.2005.113
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.96.100

K. Belhajjame, M. Roos, E. Garcia-cuesta, G. K. Zhao, D. De-roure et al., Why Workflows Break -Understanding and Combating Decay in Taverna Workflows, Proceedings of the 2012 IEEE 8th International Conference on E-Science (e-Science), E-SCIENCE '12, pp.1-9, 2012.

M. Berman, J. S. Chase, L. Landweber, A. Nakao, M. Ott et al., GENI: A federated testbed for innovative network experiments, Computer Networks, vol.61, issue.0, pp.615-638, 2014.
DOI : 10.1016/j.bjp.2013.12.037

O. Biton, S. Cohen-boulakia, S. B. Davidson, and C. S. Hara, Querying and Managing Provenance through User Views in Scientific Workflows, 2008 IEEE 24th International Conference on Data Engineering, pp.1072-1081, 2008.
DOI : 10.1109/ICDE.2008.4497516

C. Boettiger, An introduction to Docker for reproducible research, with examples from the R environment. CoRR, abs, 1410.

T. Bourgeau, J. Auge, and T. Friedman, TopHat: Supporting Experiments through Measurement Infrastructure Federation, Proceedings of TridentCom'2010, 2010.
DOI : 10.1145/1113361.1113374
URL : https://hal.archives-ouvertes.fr/hal-00724834

T. Buchert, Orchestration d'expériences à l'aide de processus métier, ComPAS : Conférence d'informatique en Parallélisme, 2012.

T. Buchert, E. Jeanvoine, and L. Nussbaum, Emulation at Very Large Scale with Distem, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2014.
DOI : 10.1109/CCGrid.2014.64
URL : https://hal.archives-ouvertes.fr/hal-00959616

T. Buchert and L. Nussbaum, Leveraging business workflows in distributed systems research for the orchestration of reproducible and scalable experiments, 9ème édition de la conférence Manifestation des Jeunes Chercheurs en Sciences et Technologies de l'Information et de la Communication (2012), 2012.
URL : https://hal.archives-ouvertes.fr/hal-00724313

T. Buchert, L. Nussbaum, and J. Gustedt, Accurate Emulation of CPU Performance, 8th International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Platforms (HeteroPar), 2010.
DOI : 10.1142/S0129626409000304
URL : https://hal.archives-ouvertes.fr/inria-00490108

T. Buchert, L. Nussbaum, and J. Gustedt, Methods for Emulation of Multi-core CPU Performance, 2011 IEEE International Conference on High Performance Computing and Communications, 2011.
DOI : 10.1109/HPCC.2011.45
URL : https://hal.archives-ouvertes.fr/inria-00535534

T. Buchert, L. Nussbaum, and J. Gustedt, A Workflow-Inspired, Modular and Robust Approach to Experiments in Distributed Systems, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2014.
DOI : 10.1109/CCGrid.2014.33
URL : https://hal.archives-ouvertes.fr/hal-00909347

T. Buchert, L. Nussbaum, and J. Gustedt, Towards Complete Tracking of Provenance in Experimental Distributed Systems Research, 2015.
DOI : 10.1007/978-3-319-27308-2_49
URL : https://hal.archives-ouvertes.fr/hal-01191855

T. Buchert, C. Ruiz, L. Nussbaum, and O. Richard, A survey of general-purpose experiment management tools for distributed systems, Future Generation Computer Systems, vol.45, issue.0, pp.1-12, 2015.
DOI : 10.1016/j.future.2014.10.007
URL : https://hal.archives-ouvertes.fr/hal-01087519

A. Burtsev, N. Mishrikoti, E. Eide, and R. Ricci, Weir: a streaming language for performance analysis, Proceedings of the Seventh Workshop on Programming Languages and Operating Systems, PLOS '13, pp.1-6, 2013.

A. Burtsev, P. Radhakrishnan, M. Hibler, and J. Lepreau, Transparent checkpoints of closed distributed systems in emulab, Proceedings of the fourth ACM european conference on Computer systems, EuroSys '09, pp.173-186, 2009.
DOI : 10.1145/1519065.1519084

P. Steven, J. Callahan, E. Freire, C. E. Santos, C. T. Scheidegger et al., VisTrails: visualization meets data management, Proceedings of the 2006 ACM SIGMOD international conference on Management of data, SIGMOD '06, pp.745-747, 2006.

M. Caneill and S. Zacchiroli, Debsources, Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM '14, pp.1-28, 2014.
DOI : 10.1145/2652524.2652528

O. Louis-claude-canon, J. Dubuisson, E. Gustedt, and . Jeannot, Defining and controlling the heterogeneity of a cluster: The Wrekavoc tool, Journal of Systems and Software, vol.83, issue.5, pp.786-802, 2010.
DOI : 10.1016/j.jss.2009.11.734

C. Louis, E. Canon, and . Jeannot, Wrekavoc: a Tool for Emulating Heterogeneity, Heterogenity in Computing Workshop (HCW) in International Parallel and Distributed Processing Symposium (IPDPS), 2008.

F. Cappello, F. Desprez, M. Dayde, E. Jeannot, Y. Jégou et al., Grid'5000: a large scale, reconfigurable, controlable and monitorable Grid platform, 6th IEEE/ACM International Workshop on Grid Computing (Grid), pp.99-106, 2005.
URL : https://hal.archives-ouvertes.fr/inria-00000284

M. Carbone and L. Rizzo, Adding emulation to planetlab nodes, Proceedings of the 5th international student workshop on Emerging networking experiments and technologies, Co-Next Student Workshop '09, pp.41-42, 2009.
DOI : 10.1145/1658997.1659020

M. Carbone and L. Rizzo, Dummynet revisited, ACM SIGCOMM Computer Communication Review, vol.40, issue.2, pp.12-20, 2010.
DOI : 10.1145/1764873.1764876

M. Carbone and L. Rizzo, An emulation tool for PlanetLab, Computer Communications, vol.34, issue.16, pp.1980-1990, 2011.
DOI : 10.1016/j.comcom.2011.06.004

A. Carpen-amarie, A. Rougier, and F. Lübbe, Stepping Stones to Reproducible Research: A Study of Current Practices in Parallel Computing, Luís Lopes, Julius ?ilinskas, Alexandru Costan Euro-Par 2014: Parallel Processing Workshops, pp.499-510, 2014.
DOI : 10.1007/978-3-319-14325-5_43

H. Casanova, A. Legrand, and M. Quinson, SimGrid: A Generic Framework for Large-Scale Distributed Experiments, Tenth International Conference on Computer Modeling and Simulation (uksim 2008), pp.126-131, 2008.
DOI : 10.1109/UKSIM.2008.28
URL : https://hal.archives-ouvertes.fr/inria-00260697

G. Vinton and . Cerf, Avoiding Bit Rot " : Long-Term Preservation of Digital Information, Proceedings of the IEEE, pp.915-916, 2011.

D. Tushar, R. Chandra, J. Griesemer, and . Redstone, Paxos Made Live: An Engineering Perspective, Proceedings of the Twenty-sixth Annual ACM Symposium on Principles of Distributed Computing, PODC '07, pp.398-407, 2007.

J. Cheney, L. Chiticariu, and W. Tan, Provenance in Databases: Why, How, and Where, Foundations and Trends in Databases, vol.1, issue.4, pp.379-474, 2009.
DOI : 10.1561/1900000006

G. Benoit-claudel, O. Huard, and . Richard, TakTuk, adaptive deployment of remote executions, Proceedings of the 18th ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), HPDC '09, pp.91-100, 2009.

S. Cohen, S. Cohen-boulakia, and S. Davidson, Towards a Model of Provenance and User Views in Scientific Workflows, Proceedings of the Third International Conference on Data Integration in the Life Sciences, DILS'06, pp.264-279, 2006.
DOI : 10.1007/11799511_24

C. James, J. Corbett, M. Dean, A. Epstein, C. Fikes et al., Spanner: Google's globally distributed database, ACM Transactions on Computer Systems (TOCS), issue.3, p.318, 2013.

P. Costa, M. Migliavacca, P. Pietzuch, and A. L. Wolf, NaaS: Network-as-a-Service in the Cloud, 2nd USENIX Workshop on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services

V. Curcin and M. Ghanem, Scientific workflow systems - can one size fit all?, 2008 Cairo International Biomedical Engineering Conference, pp.1-9, 2008.
DOI : 10.1109/CIBEC.2008.4786077

M. Vasa-curcin, Y. Ghanem, and . Guo, The design and implementation of a workflow analysis tool, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol.30, issue.6, pp.4193-4208, 1926.
DOI : 10.1371/journal.pone.0002522

L. Dabbish, C. Stuart, J. Tsay, and J. Herbsleb, Social coding in GitHub, Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, CSCW '12, pp.1277-1286, 2012.
DOI : 10.1145/2145204.2145396

S. B. Davidson, S. C. Boulakia, A. Eyal, B. Ludäscher, T. M. Mcphillips et al., Provenance in Scientific Workflow Systems, IEEE Data Eng. Bull, vol.30, issue.4, pp.44-50, 2007.

B. Susan, J. Davidson, and . Freire, Provenance and scientific workflows: challenges and opportunities, Proceedings of ACM SIGMOD, pp.1345-1350, 2008.

A. Davison, Automated Capture of Experiment Context for Easier Reproducibility in Computational Research, Computing in Science & Engineering, vol.14, issue.4, pp.48-56, 2012.
DOI : 10.1109/MCSE.2012.41
URL : https://hal.archives-ouvertes.fr/hal-01055702

A. De-moor and H. Delugach, Difference graphs, Proc. of Common Semantics for Sharing Knowledge: Contributions to the 13th International Conference on Conceptual Structures (ICCS 2005), pp.41-53, 2005.

J. Dean and S. Ghemawat, MapReduce, Communications of the ACM, vol.51, issue.1, pp.107-113, 2008.
DOI : 10.1145/1327452.1327492

G. Decandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman et al., Dynamo, ACM SIGOPS Operating Systems Review, vol.41, issue.6, pp.205-220, 2007.
DOI : 10.1145/1323293.1294281

E. Deelman, D. Gannon, M. Shields, and I. Taylor, Workflows and e-Science: An overview of workflow system features and capabilities, Future Generation Computer Systems, vol.25, issue.5, pp.528-540, 2009.
DOI : 10.1016/j.future.2008.06.012

E. Deelman, G. Singh, M. Hui-su, J. Blythe, C. Gil et al., Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems, Scientific Programming, vol.13, issue.3, pp.219-237, 2005.
DOI : 10.1155/2005/128026

Y. Denneulin, E. Romagnoli, and D. Trystram, A synthetic workload generator for cluster computing, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings., p.243, 2004.
DOI : 10.1109/IPDPS.2004.1303297

J. Peter and . Denning, Is computer science science?, Communications of the ACM, vol.48, issue.4, pp.27-31, 2005.

W. Edsger and . Dijkstra, Notes on Structured Programming. circulated privately, 1970.

J. Dike, A user-mode port of the linux kernel, Proceedings of the 4th Annual Linux Showcase & Conference (ALS), pp.7-7, 2000.

J. Dike, User-mode Linux, Proceedings of the 5th Annual Linux Showcase & Conference (ALS), pp.2-2, 2001.

E. Dolstra, E. Merijn-de-jonge, and . Visser, Nix: A Safe and Policy-Free System for Software Deployment, Proceedings of the 18th USENIX Conference on System Administration, LISA '04, pp.79-92, 2004.

E. Dolstra and A. Löh, NixOS: A Purely Functional Linux Distribution, Proceedings of the 13th ACM SIGPLAN International Conference on Functional Programming, ICFP '08, pp.367-378, 2008.

L. David, A. Donoho, I. Maleki, M. Ur-rahman, V. Shahram et al., Reproducible Research in Computational Harmonic Analysis, Computing in Science and Engineering, vol.11, issue.1, pp.8-18, 2009.

C. Drummond, Replicability is not reproducibility: Nor is it good science, Proceedings of the Evaluation Methods for Machine Learning Workshop at the 26th ICML, pp.4972-4975, 2009.

C. Dr and . Drummond, Reproducible Research: a Dissenting Opinion, 2012.

O. Dubuisson, J. Gustedt, and E. Jeannot, Validating Wrekavoc: A tool for heterogeneity emulation, 2009 IEEE International Symposium on Parallel & Distributed Processing, 2009.
DOI : 10.1109/IPDPS.2009.5160913
URL : https://hal.archives-ouvertes.fr/inria-00435609

J. T. Dudley and A. J. Butte, In silico research in the era of cloud computing, Nature Biotechnology, vol.367, issue.11, pp.1181-1185, 2010.
DOI : 10.1101/gr.4086505

C. Dwertmann, E. Mesut, G. Jourjon, M. Ott, T. Rakotoarivelo et al., Mobile Experiments Made Easy with OMF/Orbit, SIGCOMM 2009, Conference on Applications, Technologies , Architectures, and Protocols for Computer Communications, 2009.

E. Eide, L. Stoller, and J. Lepreau, An Experimentation Workbench for Replayable Networking Research, Proceedings of the 4th Symposium on Networked System Design and Implementation (NSDI), pp.215-228, 2007.

E. Eide, L. Stoller, T. Stack, J. Freire, and J. Lepreau, Integrated scientific workflow management for the Emulab network testbed, Proceedings of the annual conference on USENIX '06 Annual Technical Conference, ATEC '06, pp.33-33, 2006.

E. N. Mootaz, L. Elnozahy, Y. Alvisi, D. B. Wang, and . Johnson, A Survey of Rollback-recovery Protocols in Message-passing Systems, ACM Comput. Surv, vol.34, issue.3, pp.375-408, 2002.

T. Fahringer, J. Qin, and S. Hainzer, Specification of grid workflow applications with AGWL: an Abstract Grid Workflow Language, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005., pp.676-685, 2005.
DOI : 10.1109/CCGRID.2005.1558629

T. Fahringer, R. Prodan, R. Duan, J. Hofer, F. Nadeem et al., ASKALON: A Development and Grid Computing Environment for Scientific Workflows, Workklows for e-Science, pp.450-471, 2007.
DOI : 10.1007/978-1-84628-757-2_27

W. Felter, A. Ferreira, R. Rajamony, and J. Rubio, An updated performance comparison of virtual machines and Linux containers, 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2014.
DOI : 10.1109/ISPASS.2015.7095802

J. Philip, J. J. Fleming, and . Wallace, How Not to Lie with Statistics: The Correct Way to Summarize Benchmark Results, Commun. ACM, vol.29, issue.3, pp.218-221, 1986.

I. Foster and C. Kesselman, Globus: a Metacomputing Infrastructure Toolkit, International Journal of High Performance Computing Applications, vol.11, issue.2, pp.115-128, 1996.
DOI : 10.1177/109434209701100205

G. Fox, J. Gregor-von-laszewski, K. Diaz, J. Keahey, R. Fortes et al., FutureGrid-a reconfigurable testbed for Cloud, HPC, and Grid Computing. Contemporary High Performance Computing: From Petascale toward Exascale, Computational Science, 2013.

C. Freire, A. Quereilhac, T. Turletti, and W. Dabbous, Automated Deployment and Customization of Routing Overlays on Planetlab, Testbeds and Research Infrastructure. Development of Networks and Communities, pp.240-255, 2012.
DOI : 10.1145/354871.354874
URL : https://hal.archives-ouvertes.fr/hal-01267295

J. Freire, D. Koop, E. Santos, and C. T. Silva, Provenance for Computational Tasks: A Survey, Computing in Science & Engineering, vol.10, issue.3, pp.11-21, 2008.
DOI : 10.1109/MCSE.2008.79

J. Freire, C. Silva, . Stevenp, E. Callahan, C. Santos et al., Managing Rapidly-Evolving Scientific Workflows, Provenance and Annotation of Data, pp.10-18, 2006.
DOI : 10.1007/11890850_2
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.117.5530

L. John, P. W. Furlani, and . Osel, Abstract Yourself With Modules, Proceedings of the 10th USENIX Conference on System Administration, LISA '96, pp.193-204, 1996.

W. Galuba, K. Aberer, Z. Despotovic, and W. Kellerer, ProtoPeer: A P2P Toolkit Bridging the Gap Between Simulation and Live Deployement, Proceedings of the Second International ICST Conference on Simulation Tools and Techniques, pp.1-60, 2009.
DOI : 10.4108/ICST.SIMUTOOLS2009.5681

D. Garijo, P. Alper, K. Belhajjame, O. Corcho, Y. Gil et al., Common motifs in scientific workflows: An empirical analysis, 2012 IEEE 8th International Conference on E-Science, pp.338-351, 2014.
DOI : 10.1109/eScience.2012.6404427
URL : https://hal.archives-ouvertes.fr/hal-01342933

P. Ian, . Gent, A. Stuart, E. Grant, P. Macintyre et al., How not to do it, 1997.

C. Gentry, A fully homomorphic encryption scheme, 2009.

G. Gibson, Reflections on Failure in Post-Terascale Parallel Computing, Int. Conf. on Parallel Processingcse.ohio-state, 2007.

Y. Gil, V. Ratnakar, J. Kim, P. A. González-calero, P. T. Groth et al., Wings: Intelligent Workflow-Based Design of Computational Experiments, IEEE Intelligent Systems, 2011.
DOI : 10.1109/MIS.2010.9

J. Goecks and A. Nekrutenko, Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences, Genome Biology, vol.11, issue.8, p.86, 2010.
DOI : 10.1186/gb-2010-11-8-r86

O. S. Gómez, N. Juristo, and S. Vegas, Replications types in experimental disciplines, Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM '10, pp.1-3, 2010.
DOI : 10.1145/1852786.1852790

A. Grau, S. Maier, K. Herrmann, and K. Rothermel, Time Jails: A Hybrid Approach to Scalable Network Emulation, 2008 22nd Workshop on Principles of Advanced and Distributed Simulation, pp.7-14, 2008.
DOI : 10.1109/PADS.2008.19

R. Guillier and P. Primet, A User-oriented Test Suite for Transport Protocols Comparison in Datagrid Context, Proceedings of the 23rd International Conference on Information Networking, ICOIN'09, pp.265-269, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00790586

J. Philip and . Guo, Sootware Tools to Facilitate Research Programming, 2012.

D. Gupta, K. V. Vishwanath, and A. Vahdat, DieCast, Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI), pp.407-421, 2008.
DOI : 10.1145/1963559.1963560

J. Gustedt, E. Jeannot, and M. Quinson, EXPERIMENTAL METHODOLOGIES FOR LARGE-SCALE SYSTEMS: A SURVEY, Parallel Processing Letters, vol.19, issue.03, pp.399-418, 2009.
DOI : 10.1142/S0129626409000304
URL : https://hal.archives-ouvertes.fr/inria-00364180

B. Howe, Virtual Appliances, Cloud Computing, and Reproducible Research, Computing in Science & Engineering, vol.14, issue.4, pp.36-41, 2012.
DOI : 10.1109/MCSE.2012.62

S. Hunold and J. Träff, On the State and Importance of Reproducible Experimental Research in Parallel Computing. CoRR, abs/1308, 2013.

P. Hunt, M. Konar, F. P. Junqueira, and B. Reed, ZooKeeper: Wait-free Coordination for Internet-scale Systems, Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference, USENIX- ATC'10, pp.11-11, 2010.

M. Imbert, L. Pouilloux, J. Rouzaud-cornabas, A. Lèbre, and T. Hirofuchi, Using the EXECO toolbox to perform automatic and reproducible cloud experiments, 1st International Workshop on UsiNg and building ClOud Testbeds (UNICO, collocated with IEEE CloudCom 2013, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00861886

D. C. Ince, L. Hatton, and J. Graham-cumming, The case for open computer programs, Nature, vol.20, issue.7386, pp.482485-488, 2012.
DOI : 10.1038/nature10836

R. Jain, The Art of Computer Systems Performance Analysis; Techniques for Experimental Design, Measurement, Simulation and Modelling, 1991.

G. Jourjon, S. Kanhere, and J. Yao, Impact of IREEL on CSE Lectures, the 16th Annual Conference on Innovation and Technology in Computer Science Education (ACM ITiCSE 2011), pp.1-6, 2011.

G. Jourjon, T. Rakotoarivelo, and M. Ott, From Learning to Researching -Ease the shift through testbeds, Internatinonal ICST Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities (TridentCom), pp.496-505, 2010.

G. Jourjon, T. Rakotoarivelo, and M. Ott, Why simulate when you can experience?, In ACM Special Interest Group on Data Communications (ACM SIGCOMM) Education Workshop, 2011.

G. Jourjon, T. Rakotoarivelo, and M. Ott, A Portal to Support Rigorous Experimental Methodology in Networking Research, Testbeds and Research Infrastructure. Development of Networks and Communities, pp.223-238, 2012.
DOI : 10.1007/978-3-642-17851-1_26

T. Kleinjung, K. Aoki, J. Franke, A. Lenstra, E. Thomé et al., Factorization of a 768-Bit RSA Modulus, 2010.
DOI : 10.1007/978-3-642-14623-7_18
URL : https://hal.archives-ouvertes.fr/inria-00444693

J. Klinginsmith, M. Mahoui, and Y. M. Wu, Towards Reproducible eScience in the Cloud, 2011 IEEE Third International Conference on Cloud Computing Technology and Science, pp.582-586, 2011.
DOI : 10.1109/CloudCom.2011.89

D. E. Knuth, Literate Programming, The Computer Journal, vol.27, issue.2, pp.97-111, 1984.
DOI : 10.1093/comjnl/27.2.97

K. L. Ryan and . Ko, A computer scientist's introductory guide to business process management (BPM), Crossroads, vol.154, issue.4, pp.11-418, 2009.

M. Mathieu-lacage, M. Ferrari, T. Hansen, W. Turletti, and . Dabbous, NEPI, ACM SIGOPS Operating Systems Review, vol.43, issue.4, pp.60-65, 2010.
DOI : 10.1145/1713254.1713268

F. Leisch and . Sweave, Sweave: Dynamic Generation of Statistical Reports Using Literate Data Analysis, Proceedings in Computational Statistics (COMPSTAT), pp.575-580, 2002.
DOI : 10.1007/978-3-642-57489-4_89

L. Leonini, É. Rivière, and P. Felber, SPLAY: distributed systems evaluation made simple (or how to turn ideas into live systems in a breeze), Proceedings of the 6th USENIX symposium on Networked systems design and implementation, NSDI'09, pp.185-198, 2009.

S. Marru, L. Gunathilake, C. Herath, P. Tangchaisin, M. Pierce et al., Apache airavata, Proceedings of the 2011 ACM workshop on Gateway computing environments, GCE '11, pp.21-28, 2011.
DOI : 10.1145/2110486.2110490

S. Martin, T. Buchert, P. Willemet, O. Richard, E. Jeanvoine et al., Scalable and Reliable Data Broadcast with Kascade, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops, 2014.
DOI : 10.1109/IPDPSW.2014.191
URL : https://hal.archives-ouvertes.fr/hal-00957671

D. Mccafferty, Should code be released?, Communications of the ACM, vol.53, issue.10, pp.16-17, 2010.
DOI : 10.1145/1831407.1831415

J. D. Mccalpin, STREAM: Sustainable Memory Bandwidth in High Performance Computers

T. Mcphillips, S. Bowers, D. Zinn, and B. Ludäscher, Scientific workflow design for mere mortals, Future Generation Computer Systems, vol.25, issue.5, pp.541-551, 2009.
DOI : 10.1016/j.future.2008.06.013

D. Medhi, B. Ramamurthy, C. Scoglio, J. P. Rohrer, E. K. Çetinkaya et al., The GpENI testbed: Network infrastructure, implementation experience, and experimentation, Computer Networks, vol.61, pp.51-74, 2014.
DOI : 10.1016/j.bjp.2013.12.027

J. P. Mesirov, Accessible Reproducible Research, Science, vol.327, issue.5964, pp.415-416, 2010.
DOI : 10.1126/science.1179653
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3878063

J. Mirkovic, T. V. Benzel, T. Faber, R. Braden, J. T. Wroclawski et al., The DETER project: Advancing the science of cyber security experimentation and test, 2010 IEEE International Conference on Technologies for Homeland Security (HST), pp.1-7, 2010.
DOI : 10.1109/THS.2010.5655108

P. V. Mockapetris, Domain names -implementation and specification Updated by RFCs 1101, RFC 1035 (INTERNET STANDARD), pp.4034-4035, 1183.

L. Moreau, B. Clifford, J. Freire, J. Futrelle, Y. Gil et al., The Open Provenance Model core specification (v1.1), Future Generation Computer Systems, vol.27, issue.6, pp.27743-756, 2011.
DOI : 10.1016/j.future.2010.07.005

L. Moreau, B. Ludäscher, I. Altintas, R. S. Barga, S. Bowers et al., Special Issue: The First Provenance Challenge, Concurrency and Computation: Practice and Experience, pp.409-418, 2008.
DOI : 10.1002/cpe.1233

T. Mytkowicz, A. Diwan, M. Hauswirth, and P. F. Sweeney, Producing wrong data without doing anything obviously wrong!, Proceedings of the 14th international conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), ASPLOS '09, pp.265-276, 2009.

S. Naicken, B. Livingston, A. Basu, S. Rodhetbhai, I. Wakeman et al., The state of peer-to-peer simulators and simulations, ACM SIGCOMM Computer Communication Review, vol.37, issue.2, pp.95-98, 2007.
DOI : 10.1145/1232919.1232932

T. Nguyen, J. Desideri, and L. Trifan, A Fault-Tolerant Approach to Distributed Applications Las Vegas, United States This work is supported by the European Commission FP7 Cooperation Program " Transport (incl.aeronautics) " , for the GRAIN Coordination and Support Action ( " Greener Aeronautics International Networking, Parallel and Distributed Processing Techniques and Applications (PDPTA'13) It is also supported by the French National Research Agency ANR (Agence Nationale de la Recherche) for the OMD2 project (Optimisation Multi-Disciplines Distribuée), grant ANR-08-COSI-007, program COSINUS (Conception et Simulation), 2013.

L. Nussbaum and O. Richard, Lightweight Emulation to Study Peerto-Peer Systems, 3rd International Workshop on Hot Topics in Peer-to-Peer Systems (Hot-P2P), 2006.

L. Nussbaum and O. Richard, A Comparative Study of Network Link Emulators, Communications and Networking Simulation Symposium (CNS), 2009.
URL : https://hal.archives-ouvertes.fr/inria-00425613

T. Oinn, M. Addis, J. Ferris, D. Marvin, T. Carver et al., Taverna: a tool for the composition and enactment of bioinformatics workflows, Bioinformatics, vol.20, issue.17, pp.3045-3054, 2004.
DOI : 10.1093/bioinformatics/bth361

M. Ott, I. Seskar, R. Siraccusa, and M. Singh, ORBIT Testbed Software Architecture: Supporting Experiments as a Service, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities, pp.136-145, 2005.
DOI : 10.1109/TRIDNT.2005.27

D. Peng and F. Dabek, Large-scale Incremental Processing Using Distributed Transactions and Notifications, Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation, 2010.

L. Peterson, T. Anderson, D. Culler, and T. Roscoe, A blueprint for introducing disruptive technology into the Internet, ACM SIGCOMM Computer Communication Review, vol.33, issue.1, pp.59-64, 2003.
DOI : 10.1145/774763.774772

L. Peterson, A. Bavier, and S. Bhatia, VICCI: A programmable cloud-computing research testbed, 2011.

A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary, HPL -A Portable Implementation of the High-Performance Linpack Benchmark for Distributed- Memory Computers

B. Pfaff, J. Pettit, T. Koponen, K. Amidon, M. Casado et al., Extending networking into the virtualization layer, 8th ACM Workshop on Hot Topics in Networks (HotNets-VIII), 2009.

E. Pinheiro, W. Weber, and L. Barroso, Failure Trends in a Large Disk Drive Population, 5th USENIX Conference on File and Storage Technologies, pp.17-29, 2007.

R. Prodan, T. Fahringer, and F. Franz, On using ZENTURIO for performance and parameter studies on cluster and Grid architectures, Eleventh Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2003. Proceedings., pp.185-192, 2003.
DOI : 10.1109/EMPDP.2003.1183587

A. Quereilhac, M. Lacage, C. Freire, T. Turletti, and W. Dabbous, NEPI: An integration framework for Network Experimentation, 19th International Conference on Sootware, Telecommunications and Computer Networks (SootCOM), pp.1-5, 2011.

A. Quereilhac, D. Camara, T. Turletti, and W. Dabbous, Experimentation with large scale ICN multimedia services on the Internet made easy, IEEE COMSOC MMTC E-Letter, vol.8, issue.4, pp.10-12, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00840235

A. Quereilhac, D. Saucez, P. Mahadevan, T. Turletti, and W. Dabbous, Demonstrating a unified ICN development and evaluation framework, Proceedings of the 1st international conference on Information-centric networking, INC '14, pp.195-196, 2014.
DOI : 10.1145/2660129.2660132
URL : https://hal.archives-ouvertes.fr/hal-01066633

A. Quereilhac, D. Saucez, T. Turletti, and W. Dabbous, Automating ns-3 experimentation in multi-host scenarios, Proceedings of the 2015 Workshop on ns-3, WNS3 '15, 2015.
DOI : 10.1145/2756509.2756513
URL : https://hal.archives-ouvertes.fr/hal-01141000

M. Quinson, C. Rosa, and C. Thiery, Parallel Simulation of Peer-to-Peer Systems, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012), 2012.
DOI : 10.1109/CCGrid.2012.115
URL : https://hal.archives-ouvertes.fr/inria-00602216

T. Rakotoarivelo, M. Ott, G. Jourjon, and I. Seskar, OMF, ACM SIGOPS Operating Systems Review, vol.43, issue.4, pp.54-59, 2010.
DOI : 10.1145/1713254.1713267
URL : https://hal.archives-ouvertes.fr/hal-01153181

D. Raychaudhuri, I. Seskar, M. Ott, S. Ganu, K. Ramachandran et al., Overview of the ORBIT radio grid testbed for evaluation of next-generation wireless network protocols, IEEE Wireless Communications and Networking Conference, 2005, pp.1664-1669, 2005.
DOI : 10.1109/WCNC.2005.1424763

R. Ricci, G. Wong, L. Stoller, K. Webb, J. Duerig et al., Apt, ACM SIGOPS Operating Systems Review, vol.49, issue.1, 2015.
DOI : 10.1145/2723872.2723885

L. Rizzo, Dummynet, ACM SIGCOMM Computer Communication Review, vol.27, issue.1, pp.31-41, 1997.
DOI : 10.1145/251007.251012

R. Rojas, How to make Zuse's Z3 a universal computer, IEEE Annals of the History of Computing, vol.20, issue.3, pp.51-54, 1998.
DOI : 10.1109/85.707574

T. Pais-pitta-de-lacerda-ruivo, G. Bernabeu-altayo, G. Garzoglio, S. Timm, H. Kim et al., Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing, CCGRID Scale Challenge, pp.943-948, 2014.

C. Ruiz, M. Alenxandru, O. Richard, T. Monteil, and H. Aubert, Platform Calibration for Load Balancing of Large Simulations: TLM Case, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2014.
DOI : 10.1109/CCGrid.2014.26
URL : https://hal.archives-ouvertes.fr/hal-01228344

C. Camilo, R. Sanabria, O. Richard, B. Videau, and I. Oleg, Managing Large Scale Experiments in Distributed Testbeds, Proceedings of the 11th IASTED International Conference, pp.628-636, 2013.

I. Santana-perez, R. Ferreira-da-silva, M. Rynge, E. Deelman, M. Pérez-hernández et al., A Semantic-Based Approach to Attain Reproducibility of Computational Environments in Scientific Workflows: A Case Study, Euro-Par 2014: Parallel Processing Workshops, pp.452-463, 2014.
DOI : 10.1007/978-3-319-14325-5_39

L. Sarzyniec, T. Buchert, E. Jeanvoine, and L. Nussbaum, Design and Evaluation of a Virtual Experimental Environment for Distributed Systems, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, pp.172-179, 2013.
DOI : 10.1109/PDP.2013.32
URL : https://hal.archives-ouvertes.fr/hal-00724308

E. Schulte, D. Davison, T. Dye, and C. Dominik, A Multi-Language Computing Environment for Literate Programming and Reproducible Research, Journal of Statistical Software, vol.46, issue.3, pp.1-24
DOI : 10.18637/jss.v046.i03

H. Schulze and K. Mochalski, Internet study, 2008.

M. Schwab, M. Karrenbach, and J. Claerbout, Making scientific computations reproducible, Computing in Science & Engineering, vol.2, issue.6, pp.61-67, 2000.
DOI : 10.1109/5992.881708

D. Schwerdel, D. Günther, R. Henjes, B. Reuther, and P. Müller, German-Lab Experimental Facility, Proceedings of the Third Future Internet Conference on Future Internet, FIS'10, pp.1-10, 2010.
DOI : 10.1145/1113361.1113374

D. Schwerdel, B. Reuther, T. Zinner, P. Müller, and P. Tran-gia, Future Internet research and experimentation: The G-Lab approach, Computer Networks, vol.61, 2014.
DOI : 10.1016/j.bjp.2013.12.023

R. Sherwood, G. Gibb, G. Kok-kiong-yap, M. Appenzeller, N. Casado et al., Can the Production Network Be the Testbed?, Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, OSDI'10, pp.1-6, 2010.

C. Siaterlis and M. Masera, A survey of software tools for the creation of networked testbeds, International Journal On Advances in Security, vol.3, issue.1 2, pp.1-12, 2010.

L. Yogesh, B. Simmhan, D. Plale, and . Gannon, A survey of data provenance in e-science, SIGMOD Rec, vol.34, issue.3, pp.31-36, 2005.

J. Singer, A literate experimentation manifesto, Proceedings of the 10th SIGPLAN symposium on New ideas, new paradigms, and reflections on programming and software, ONWARD '11, pp.91-102, 2011.
DOI : 10.1145/2048237.2048249

D. Spinellis, A Repository with 44 Years of Unix Evolution, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, pp.13-16, 2015.
DOI : 10.1109/MSR.2015.64

N. Spring, L. Peterson, A. Bavier, and V. Pai, Using PlanetLab for network research, ACM SIGOPS Operating Systems Review, vol.40, issue.1, pp.17-24, 2006.
DOI : 10.1145/1113361.1113368

L. Stanisic, A. Legrand, and V. Danjean, An Effective Git And Org-Mode Based Workflow For Reproducible Research, ACM SIGOPS Operating Systems Review, vol.49, issue.1, pp.61-70, 2015.
DOI : 10.1145/2723872.2723881
URL : https://hal.archives-ouvertes.fr/hal-01112795

P. G. James, D. Sterbenz, P. Hutchison, C. Müller, and . Elliott, Special issue on Future Internet Testbeds, Computer Networks, vol.63, issue.0, pp.1-4, 2014.

D. Talia, Workflow Systems for Science: Concepts and Tools, ISRN Software Engineering, vol.37, issue.1, 2013.
DOI : 10.1109/TSC.2009.4

H. Tazaki, F. Uarbani, E. Mancini, M. Lacage, D. Camara et al., Direct code execution, Proceedings of the ninth ACM conference on Emerging networking experiments and technologies, CoNEXT '13, pp.217-228, 2013.
DOI : 10.1145/2535372.2535374
URL : https://hal.archives-ouvertes.fr/hal-00948727

M. Tedre and N. Moisseinen, Experiments in Computing: A Survey, The Scientific World Journal, vol.426, issue.1, 2014.
DOI : 10.1145/1297797.1297817

S. Thiell, A. Degrémont, H. Doreau, and A. Cedeyn, ClusterShell, a scalable execution framework for parallel tasks, Linux Symposium, p.77, 2012.

W. F. Tichy, Should computer scientists experiment more?, Computer, vol.31, issue.5, pp.32-40, 1998.
DOI : 10.1109/2.675631
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.399.9833

N. Topilski, J. Albrecht, and A. Vahdat, Improving scalability and fault tolerance in an application management infrastructure, First USENIX Workshop on Large-Scale Computing, LASCO'08, pp.1-2, 2008.

L. Trifan, Resiliency in Distributed Workflows, 2010.
URL : https://hal.archives-ouvertes.fr/inria-00528840

A. Vahdat, K. Yocum, K. Walsh, P. Mahadevan, D. Kosti? et al., Scalability and Accuracy in a Large-Scale Network Emulator, SIGCOMM Computer Communication Review, vol.36, pp.271-284, 2002.

M. P. Wil, A. H. Van-der-aalst, M. Hofstede, and . Weske, Business Process Management: A Survey, Proceedings of the 2003 International Conference on Business Process Management, BPM'03, pp.1-12, 2003.

B. Videau and O. Richard, Expo : un moteur de conduite d'expériences pour plates-forme dédiées, Conférence Française en Systèmes d'Exploitation (CFSE), 2008.

B. Videau, C. Touati, and O. Richard, Toward an Experiment Engine for Lightweight Grids, Proceedings of the 1st International ICST Conference on Networks for Grid Applications, pp.1-22, 2007.
DOI : 10.4108/gridnets.2007.2245
URL : https://hal.archives-ouvertes.fr/hal-01398153

J. Wainer, C. G. Barsottini, D. Lacerda, and L. Marco, Empirical evaluation in Computer Science research published by ACM, Information and Software Technology, vol.51, issue.6, pp.1081-1085, 2009.
DOI : 10.1016/j.infsof.2009.01.002

L. Wang and J. Kangasharju, LiteLab: Efficient large-scale network experiments, 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC), 2013.
DOI : 10.1109/CCNC.2016.7444732
URL : http://arxiv.org/abs/1311.7422

Y. Wang, Automating experimentation with distributed systems using generative techniques, 2006.

Y. Wang, A. Carzaniga, and A. L. Wolf, Four enhancements to automated distributed system experimentation methods, Proceedings of the 30th international conference on Sootware engineering, ICSE '08, pp.491-500, 2008.

Y. Wang, M. J. Rutherford, A. Carzaniga, and A. L. Wolf, Automating experimentation on distributed testbeds, Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering , ASE '05, pp.164-173, 2005.
DOI : 10.1145/1101908.1101934

T. Wauters, B. Vermeulen, W. Vandenberghe, P. Demeester, S. Taylor et al., Federation of Internet experimentation facilities: architecture and implementation, European Conference on Networks and Communications, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01087607

E. Weingärtner, F. Schmidt, H. Vom-lehn, T. Heer, and K. Wehrle, SliceTime: A Platform for Scalable and Accurate Network Emulation, Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, NSDI'11, pp.253-266, 2011.

M. Weske, Business Process Management: Concepts, Languages, Architectures. 978-3-540-73521-2, 2007.
DOI : 10.1007/978-3-642-28616-2

P. Wette, M. Dräxler, A. Schwabe, F. Wallaschek, M. H. Zahraee et al., MaxiNet: Distributed emulation of software-defined networks, 2014 IFIP Networking Conference, 2014.
DOI : 10.1109/IFIPNetworking.2014.6857078

B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad et al., An Integrated Experimental Environment for Distributed Systems and Networks, Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), pp.255-270, 2002.

J. White, G. Jourjon, T. Rakotoarivelo, and M. Ott, Measurement Architectures for Network Experiments with Disconnected Mobile Nodes, 6th International ICST Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, pp.315-330, 2010.
DOI : 10.1007/978-3-642-17851-1_26

M. Wilde, M. Hategan, J. M. Wozniak, B. Clifford, S. Daniel et al., Swift: A language for distributed parallel scripting, Parallel Computing, vol.37, issue.9, pp.633-652, 2011.
DOI : 10.1016/j.parco.2011.05.005

N. Wirth, Program development by stepwise refinement, Communications of the ACM, vol.14, issue.4, pp.221-227, 1971.
DOI : 10.1145/362575.362577
URL : http://e-collection.library.ethz.ch/eserv/eth:3026/eth-3026-01.pdf

K. Wolstencroft, R. Haines, D. Fellows, A. Williams, D. Withers et al., The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud, Nucleic Acids Research, vol.41, issue.W1, pp.41-557, 2013.
DOI : 10.1093/nar/gkt328

S. Reynold, J. Xin, M. Rosen, . Zaharia, J. Michael et al., Shark: SQL and rich analytics at scale, Proceedings of the 2013 ACM SIGMOD International Conference on Management of data, pp.13-24, 2013.

J. Yu and R. Buyya, A taxonomy of scientific workflow systems for grid computing, ACM SIGMOD Record, vol.34, issue.3, pp.44-49, 2005.
DOI : 10.1145/1084805.1084814

Y. Zheng and D. M. Nicol, A Virtual Time System for OpenVZ-Based Network Emulations, 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation, pp.1-10, 2011.
DOI : 10.1109/PADS.2011.5936745