I. Example and .. , 50 3.5.1 Future Test without Redesign, p.56

P. Analysis and .. Test-with-redesign, 66 4.6 Simulating Future Processes at the Design Stage, Optimization of the Safety Margins and Redesign Criterion .......... Unconservative Initial Design Approach, vol.68, issue.4, p.81

D. Summary, . .. On-possible-future-research-directions, . Design, . Partitioning, . Locating et al., 81 5 DYNAMIC, p.83

.. Dynamic-design-space-partitioning, 92 5.5.1 Moving the Sub-regions 93 5.5.2 Merge, Split and Create Sub-regions, p.96

.. Six-dimensional-analytical-example, 97 5.6.1 Experimental Setup

W. L. Oberkampf, S. M. Deland, B. M. Rutherford, K. V. Diegert, A. et al., Error and uncertainty in modeling and simulation, Reliability Engineering & System Safety, vol.75, issue.3, pp.333-357, 2002.
DOI : 10.1016/S0951-8320(01)00120-X

E. Acar, R. T. Haftka, K. , and N. H. , Effects of Structural Tests on Aircraft Safety, AIAA Journal, vol.48, issue.10, pp.2235-2248, 2010.
DOI : 10.2514/1.J050202

R. E. Melchers, Structural Reliability Analysis and Prediction, 1999.

Y. Fujimoto, C. , K. S. Hamada, K. Huang, and F. , Inspection Planning of Fatigue Deteriorating Structures Using Genetic Algorithm, International Offshore and Polar Engineering Conference, pp.99-109, 1998.
DOI : 10.2534/jjasnaoe1968.1997.182_729

M. Toyoda-makino, Cost-based optimal history-dependent inspection strategy for random fatigue crack growth, Probabilistic Engineering Mechanics, vol.14, issue.4, pp.339-347, 1999.
DOI : 10.1016/S0266-8920(98)00042-3

Y. Garbatov and C. G. Soares, Cost and reliability based strategies for fatigue maintenance planning of floating structures, Reliability Engineering & System Safety, vol.73, issue.3, pp.293-301, 2001.
DOI : 10.1016/S0951-8320(01)00059-X

A. Kale, R. T. Haftka, and B. V. Sankar, Efficient Reliability-Based Design and Inspection of Stiffened Panels Against Fatigue, Journal of Aircraft, vol.45, issue.1, pp.86-96, 2008.
DOI : 10.2514/1.22057

S. Sankararaman, K. Mclemore, C. Liang, S. C. Bradford, L. Peterson et al., Test Resource Allocation for Uncertainty Quantification of Multi-level and Coupled Systems, 52nd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, 2011.
DOI : 10.2514/6.2011-1904

I. Voutchkov and A. J. Keane, Multiobjective optimization using surrogates, 7th International Conference on Adaptive Computing in Design and Manufacture, pp.167-175, 2006.

A. Samad, K. Kim, T. Goel, R. T. Haftka, and W. Shyy, Multiple Surrogate Modeling for Axial Compressor Blade Shape Optimization, Journal of Propulsion and Power, vol.24, issue.2, pp.302-310, 2008.
DOI : 10.2514/1.28999

F. A. Viana and R. T. Haftka, Using multiple surrogates for metamodeling, 7th ASMO-UK/ISSMO International Conference on Engineering Design Optimization, 2008.

B. Glaz, T. Goel, L. Liu, P. Friedmann, and R. T. Haftka, Multiple-Surrogate Approach to Helicopter Rotor Blade Vibration Reduction, AIAA Journal, vol.47, issue.1, pp.271-282, 2009.
DOI : 10.2514/1.40291

F. A. Viana and R. T. Haftka, Surrogate-based Optimization with Parallel Simulations using the Probability of Improvement, 13th AIAA/ISSMO Multidisciplinary Analysis Optimization Conference, 2010.
DOI : 10.2514/6.2010-9392

P. J. Modi, W. Shen, M. Tambe, Y. , and M. , Adopt: asynchronous distributed constraint optimization with quality guarantees, Artificial Intelligence, vol.161, issue.1-2, pp.149-180, 2005.
DOI : 10.1016/j.artint.2004.09.003

URL : http://doi.org/10.1016/j.artint.2004.09.003

J. Holmgren, J. A. Persson, and P. Davidsson, Agent Based Decomposition of Optimization Problems, First International Workshop on Optimization in Multi-Agent Systems, 2008.

J. Welcomme, M. Gleizes, and P. Glize, R ´ esolution de probì emes multidisciplinaires multi-objectifs par systèmessyst`systèmes multi-agents adaptifs: ApplicationàApplication`Applicationà la conception préliminairepr´préliminaire avion, JournéesJourn´Journées Francophones sur les SystèmesSyst`Systèmes Multi-Agents, pp.1-15, 2007.

G. Picard and P. Glize, Model and analysis of local decision based on cooperative self-organization for problem solving, Multiagent and Grid Systems, vol.2, issue.3, pp.253-265, 2006.
DOI : 10.3233/MGS-2006-2304

URL : https://hal.archives-ouvertes.fr/hal-01122261

J. Tu, K. K. Choi, and Y. H. Park, A New Study on Reliability-Based Design Optimization, Journal of Mechanical Design, vol.121, issue.4, pp.557-564, 1999.
DOI : 10.1115/1.2829499

R. V. Grandhi and L. P. Wang, Reliability-based structural optimization using improved two-point adaptive nonlinear approximations, Finite Elements in Analysis and Design, vol.29, issue.1, pp.35-48, 1998.
DOI : 10.1016/S0168-874X(98)00007-9

X. Qu and R. T. Haftka, Reliability-based design optimization using probabilistic sufficiency factor, Structural and Multidisciplinary Optimization, vol.27, issue.5, pp.314-325, 2004.
DOI : 10.1007/s00158-004-0390-3

J. Liang, J. P. Mourelatos, and E. Nikolaidis, A Single-Loop Approach for System Reliability-Based Design Optimization, Journal of Mechanical Design, vol.129, issue.12, pp.1215-1224, 2007.
DOI : 10.1115/1.2779884

M. A. Ba-abbad, E. Nikolaidis, and R. K. Kapania, New Approach for System Reliability-Based Design Optimization, AIAA Journal, vol.44, issue.5, pp.1087-1096, 2006.
DOI : 10.2514/1.17237

Y. Wu, Y. Shin, R. Sues, C. , and M. A. Structures, Safety-Factor Based Approach for Probabilistic-Based Design Optimization, Structural Dynamics and Materials Conference, 2001.

E. Castillo, R. Minguez, A. R. Teran, A. Fernandez-canteli, R. Minguez et al., Design and sensitivity analysis using the probability-safety-factor method. An application to retaining walls, Structural Safety, vol.26, issue.2, pp.159-179, 2004.
DOI : 10.1016/S0167-4730(03)00039-0

X. Du and W. Chen, Sequential Optimization and Reliability Assessment Method for Efficient Probabilistic Design, Journal of Mechanical Design, vol.126, issue.2, pp.225-233, 2004.
DOI : 10.1115/1.1649968

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.74.5267

M. Rosenblatt, Remarks on a Multivariate Transformation, The Annals of Mathematical Statistics, vol.23, issue.3, pp.470-472, 1952.
DOI : 10.1214/aoms/1177729394

B. P. Smarslok, R. T. Haftka, L. Carraro, and D. Ginsbourger, Improving accuracy of failure probability estimates with separable Monte Carlo, International Journal of Reliability and Safety, vol.4, issue.4, pp.393-414, 2010.
DOI : 10.1504/IJRS.2010.035577

A. Kale and R. T. Haftka, Tradeoff of Weight and Inspection Cost in Reliability-Based Structural Optimization, Journal of Aircraft, vol.45, issue.1, pp.77-85, 2008.
DOI : 10.2514/1.21229

E. Acar, R. T. Haftka, N. H. Kim, and D. Buchi, Including the Effects of Future Tests in Aircraft Structural Design, 8th World Congress for Structural and Multidisciplinary Optimization, 2009.

R. H. Meyers and D. C. Montgomery, Response surface methodology: process and product optimization using design experiments, 1995.

R. H. Meyers, Classical and modern regression with applications, 2000.

J. P. Kleijnen, Kriging metamodeling in simulation: A review, European Journal of Operational Research, vol.192, issue.3, pp.707-716, 2009.
DOI : 10.1016/j.ejor.2007.10.013

T. W. Simpson, T. M. Mauery, J. J. Korte, and F. Mistree, Kriging Models for Global Approximation in Simulation-Based Multidisciplinary Design Optimization, AIAA Journal, vol.39, issue.12, pp.2233-2241, 2001.
DOI : 10.2514/2.1234

M. L. Stein, Interpolation of Spatial Data: some theory for kriging, 1999.
DOI : 10.1007/978-1-4612-1494-6

A. J. Smola and B. Schölkopfsch¨schölkopf, A tutorial on support vector regression, Statistics and Computing, vol.14, issue.3, pp.199-222, 2004.
DOI : 10.1023/B:STCO.0000035301.49549.88

J. Park and I. W. Sandberg, Universal Approximation Using Radial-Basis-Function Networks, Neural Computation, vol.2, issue.2, pp.246-257, 1991.
DOI : 10.1109/35.41401

M. Smith, Neural Networks for Statistical Modeling, 1993.

F. A. Viana, Multiple Surrogates for Prediction and Optimization, 2011.

R. Jin, X. Du, C. , and W. , The use of metamodeling techniques for optimization under uncertainty, Structural and Multidisciplinary Optimization, vol.25, issue.2, pp.99-116, 2003.
DOI : 10.1007/s00158-002-0277-0

N. V. Queipo, R. T. Haftka, W. Shyy, and T. Goel, Surrogate-based analysis and optimization, Progress in Aerospace Sciences, pp.1-28, 2005.
DOI : 10.1016/j.paerosci.2005.02.001

J. Sacks, W. J. Welch, J. , M. T. , W. et al., Design and Analysis of Computer Experiments, Statistical Science, vol.4, issue.4, pp.409-435, 1989.
DOI : 10.1214/ss/1177012413

T. W. Simpson, J. D. Peplinski, P. N. Koch, A. , and J. K. , Metamodels for Computer-based Engineering Design: Survey and recommendations, Engineering with Computers, vol.17, issue.2, pp.129-150, 2001.
DOI : 10.1007/PL00007198

L. E. Zerpa, N. V. Queipo, S. Pintos, and J. Salager, An optimization methodology of alkaline-surfactant-polymer flooding processes using field scale numerical simulation and multiple surrogates, Journal of Petroleum Science and Engineering, vol.47, pp.3-4, 2005.

T. Goel, R. T. Haftka, W. Shyy, and N. V. Queipo, Ensemble of Surrogates Structural and Multidisciplinary Optimization, pp.199-216, 2007.

E. Acar and M. Rais-rohani, Ensemble of metamodels with optimized weight factors Structural and Multidisciplinary Optimization, pp.279-294, 2010.

E. Acar, Various approaches for constructing an ensemble of metamodels using local measures Structural and Multidisciplinary Optimization, pp.879-896, 2010.

D. Ginsbourger, R. Le-riche, C. , and L. , Computational Intelligence in Expensive Optimization Problems, " chap. Kriging is, Springer series in Evolutionary Learning and Optimization, pp.131-162, 2010.

N. V. Queipo, A. Verde, S. Pintos, and R. T. Haftka, Assessing the value of another cycle in Gaussian process surrogate-based optimization, Structural and Multidisciplinary Optimization, vol.47, issue.3, pp.1-17, 2009.
DOI : 10.1007/s00158-008-0346-0

F. A. Viana, R. T. Haftka, L. T. Watson, . Aiaa-/-asme-/-asce-/-ahs-/, and . Structures, Why Not Run the Efficient Global Optimization Algorithm with Multiple Surrogates?, 51st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference<BR> 18th AIAA/ASME/AHS Adaptive Structures Conference<BR> 12th, 2010.
DOI : 10.2514/6.2010-3090

A. Chaudhuri, R. Haftka, and F. Viana, Efficient Global Optimization with Adaptive Target for Probability of Targeted Improvement, 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference<BR>20th AIAA/ASME/AHS Adaptive Structures Conference<BR>14th AIAA, pp.1-13, 2012.
DOI : 10.2514/6.2012-1681

S. Kumar, D. Villanueva, R. T. Haftka, and B. V. Sankar, Probabilistic Optimization of Integrated Thermal Protection System, 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, 2008.
DOI : 10.2514/6.2008-5928

D. Villanueva, A. Sharma, R. T. Haftka, and B. V. Sankar, Risk Allocation by Optimization of an Integrated Thermal Protection System, 8th World Congress for Structural and Multidisciplinary Optimization, 2009.

D. Villanueva, R. T. Haftka, and B. V. Sankar, Including Future Tests in the Design and Optimization of an Integrated Thermal Protection System, 51st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference<BR> 18th AIAA/ASME/AHS Adaptive Structures Conference<BR> 12th, 2010.
DOI : 10.2514/6.2010-2597

D. Villanueva, R. T. Haftka, and B. V. Sankar, Probabilistic Optimization of an Integrated Thermal Protection System Including the Effect of Future Tests, 2nd International Conference on Engineering Optimization, 2010.

D. Villanueva, R. Le-riche, P. Picard, and R. T. Haftka, A Multi-Agent System Approach To Reliability Based Design Optimization Including Future Tests, 12e Congr{è}sCongr{`Congr{è}s de la Soci{é}t{é}Soci{´Soci{é}t{Soci{é}t{´Soci{é}t{é} Francaise de Recherche Op{é}rationnelleOp{´Op{é}rationnelle et d'Aide { ` a} la Decision (ROADEF'11), 2011.

D. Villanueva, R. Le-riche, G. Picard, R. T. Haftka, and B. V. Sankar, Decomposition of System Level Reliability-Based Design Optimization to Reduce the Number of Simulations, Volume 5: 37th Design Automation Conference, Parts A and B, 2011.
DOI : 10.1115/DETC2011-47815

URL : https://hal.archives-ouvertes.fr/emse-00674806

D. C. Freeman, T. A. Talay, A. , and R. E. , Reusable launch vehicle technology program, Acta Astronautica, vol.41, issue.11, pp.777-790, 1997.
DOI : 10.1016/S0094-5765(97)00197-5

URL : http://hdl.handle.net/2060/19960053992

M. L. Blosser, Development of Advanced Metallic-Thermal-Protection System Prototype Hardware, Journal of Spacecraft and Rockets, vol.41, issue.2, pp.183-194, 2004.
DOI : 10.2514/1.9179

C. C. Poteet, H. Abu-khajeel, and S. Hsu, Preliminary Thermal-Mechanical Sizing of a Metallic Thermal Protection System, Journal of Spacecraft and Rockets, vol.41, issue.2, pp.173-182, 2004.
DOI : 10.2514/1.9174

S. K. Bapanapalli, Design of an Integrated Thermal Protection System for Future Space Vehicles, 2007.

C. Gogu, R. T. Haftka, S. K. Bapanapalli, and B. V. Sankar, Dimensionality Reduction Approach for Response Surface Approximations: Application to Thermal Design, AIAA Journal, vol.47, issue.7, pp.1700-1708, 2009.
DOI : 10.2514/1.41414

A. Sharma, Multi-fidelity design of an integral thermal protection system for future space vehicle during re-entry, 2010.

F. A. Viana, SURROGATES Toolbox User's Guide, Version 2.1, 2010.

P. Golden, H. Millwater, C. Dubinsky, and G. Singh, Experimental Resource Allocation for Statistical Simulation of Fretting Fatigue Problem (Preprint), 2012.

G. Venter and S. J. Scotti, Accounting for Proof Test Data in a Reliability-Based Design Optimization Framework, AIAA Journal, vol.50, issue.10, pp.2159-2167, 2012.
DOI : 10.2514/1.J051495

D. Rao, K. Kushwaha, H. Verma, A. Srividya, and A. , Quantification of epistemic and aleatory uncertainties in level-1 probabilistic safety assessment studies, Reliability Engineering & System Safety, vol.92, issue.7, pp.947-956, 2007.

T. Matsumura, R. T. Haftka, and B. V. Sankar, Reliability Estimation Including Redesign Following Future Test for an Integrated Thermal Protection System, 9th World Congress on Structural and Multidisciplinary Optimization, 2011.

J. R. Birge and F. Louveaux, Introduction to Stochastic Programming, Springer Series in Operations Research and Financial Engineering, 2011.

M. L. Liu and N. V. Sahinidis, Optimization in Process Planning under Uncertainty, Industrial & Engineering Chemistry Research, vol.35, issue.11, pp.4154-4165, 1996.
DOI : 10.1021/ie9504516

A. Gupta and C. D. Maranas, A Two-Stage Modeling and Solution Framework for Multisite Midterm Planning under Demand Uncertainty, Industrial & Engineering Chemistry Research, vol.39, issue.10, pp.3799-3813, 2000.
DOI : 10.1021/ie9909284

D. Zhao and D. Xue, A multi-surrogate approximation method for metamodeling, Engineering with Computers, vol.122, issue.1, pp.139-153, 2005.
DOI : 10.1007/s00366-009-0173-y

G. G. Wang and T. W. Simpson, Fuzzy clustering based hierarchical metamodeling for design space reduction and optimization, Engineering Optimization, vol.36, issue.3, pp.313-335, 2004.
DOI : 10.1080/03052150310001639911

Y. Shoham and K. Leyton-brown, Multiagent Systems: Algorithmic, Game-Theoric, and Logical Foundations, 2009.
DOI : 10.1017/CBO9780511811654

D. Beasley, D. R. Bull, M. , and R. R. , A Sequential Niche Technique for Multimodal Function Optimization, Evolutionary Computation, vol.5, issue.3, pp.101-125, 1993.
DOI : 10.1162/evco.1993.1.1.25

C. Hocaoglu and A. C. Sanderson, Multimodal Function Optimization Using Minimal Representation Size Clustering and Its Application to Planning Multipaths, Evolutionary Computation, vol.5, issue.1, pp.81-104, 1997.
DOI : 10.1162/evco.1993.1.2.101

R. Brits, A. P. Engelbrecht, and F. Van-den-bergh, Locating multiple optima using particle swarm optimization, Applied Mathematics and Computation, vol.189, issue.2, pp.1859-1883, 2007.
DOI : 10.1016/j.amc.2006.12.066

X. Li, Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization, Genetic and Evolutionary Computation Lecture Notes in Computer Science, vol.3102, pp.105-116, 2004.
DOI : 10.1007/978-3-540-24854-5_10

S. Nagendra, D. Jestin, Z. Gurdal, R. T. Haftka, and L. T. Watson, Improved genetic algorithm for the design of stiffened composite panels, Computers & Structures, vol.58, issue.3, pp.543-555, 1996.
DOI : 10.1016/0045-7949(95)00160-I

J. P. Li, M. E. Balazas, G. Parks, and P. J. Clarkson, A Species Conserving Genetic Algorithm for Multimodal Function Optimization, Evolutionary Computation, vol.1, issue.1, pp.207-234, 2002.
DOI : 10.1023/A:1008202821328

A. Torn and A. Zilinskas, Global Optimization, Lecture Notes in Computer Science, vol.350, 1989.
DOI : 10.1007/3-540-50871-6

J. Kleijen, Design and analysis of simulation experiments, 2008.

F. Aurenhammer, Voronoi diagrams---a survey of a fundamental geometric data structure, ACM Computing Surveys, vol.23, issue.3, pp.345-405, 1991.
DOI : 10.1145/116873.116880

J. A. Hartigan and M. A. Wong, Algorithm AS 136: A K-Means Clustering Algorithm, Applied Statistics, vol.28, issue.1, pp.100-108, 1979.
DOI : 10.2307/2346830

P. J. Rousseeuw, Silhouettes: A graphical aid to the interpretation and validation of cluster analysis, Journal of Computational and Applied Mathematics, vol.20, pp.53-65, 1987.
DOI : 10.1016/0377-0427(87)90125-7

D. R. Jones, M. Schonlau, W. , and W. J. , Efficient Global Optimization of Expensive Black-Box Functions, Journal of Global Optimization, vol.13, issue.4, pp.455-492, 1998.
DOI : 10.1023/A:1008306431147

K. E. Parsopoulos and M. N. Vrahatis, Modification of the Particle Swarm Optimizer for Locating All the Global Minima, Artificial Neural Networks and Genetic Algorithms, pp.324-327, 2001.
DOI : 10.1007/978-3-7091-6230-9_80

A. Torn and S. Viitanen, Topographical global optimization using pre-sampled points, Journal of Global Optimization, vol.1, issue.2, pp.267-276, 1994.
DOI : 10.1007/BF01096456

N. M. Alexandrov, D. Jr, J. E. Lewis, R. M. Torczon, and V. , A trust-region framework for managing the use of approximation models in optimization, Structural Optimization, vol.12, issue.1, pp.16-23, 1998.
DOI : 10.1007/BF01197433

M. Schonlau, Computer experiments and global optimization

J. Janusevskis, R. Le-riche, D. Ginsbourger, and R. Girdziusas, Expected Improvements for the Asynchronous Parallel Global Optimization of Expensive Functions: Potentials and Challenges, Learning and Intelligent Optimization, pp.2012-413
DOI : 10.1007/978-3-642-34413-8_37

URL : https://hal.archives-ouvertes.fr/emse-00686504

M. J. Sasena, Flexibility and Efficiency Enhancements for Constrained Global Design Optimization with Kriging Approximations by, 2002.

K. Zielinski and R. Laur, Stopping criteria for a constrained single-objective particle swarm optimization algorithm, INFORMATICA-LJUBLJANA, vol.31, issue.1, p.51, 2007.

H. P. Schwefel, Evolution and optimum seeking: the sixth generation, 1993.

D. R. Jones, C. D. Perttunen, and B. E. Stuckman, Lipschitzian optimization without the Lipschitz constant, Journal of Optimization Theory and Applications, vol.20, issue.1, pp.199-222, 2004.
DOI : 10.1007/BF00941892

T. Matsumura, R. Haftka, K. , N. Aiaa-/-asme-/-asce-/-ahs-/, and . Structures, Contribution of Building-block test to discover unexpected failure modes, 52nd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, 2011.
DOI : 10.2514/6.2011-1764

D. Villanueva, R. T. Haftka, and B. V. Sankar, Including the Effect of a Future Test and Redesign in Reliability Calculations, AIAA Journal, vol.49, issue.12, pp.2760-2769, 2011.
DOI : 10.2514/1.J051150

Y. Xiong, W. Chen, D. Apley, and X. Ding, A non-stationary covariance-based Kriging method for metamodelling in engineering design, International Journal for Numerical Methods in Engineering, vol.128, issue.6, pp.733-756, 2007.
DOI : 10.1002/nme.1969