Real-Parameter Black-Box Optimisation: Benchmarking and Designing Algorithms

Raymond Ros 1
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : In continuous optimisation a given problem can be stated as follows: given the objective function f from R^n to R with n the dimension of the problem, find a suitable vector that minimises f up to an arbitrary numerical precision. In this context, the black-box scenario assumes that no information but the evaluation of f is available to guide its optimisation. In the first part, we study the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) which is a well-established stochastic approach for solving Black-Box Optimisation (BBO) problems. We show its time and space complexity limits when addressing high-dimensional BBO problems. To overcome such limits, we provide variants of the CMA-ES that update only block-diagonal elements of the covariance matrix, and exploit the separability of the problem. We show that on non-separable functions these variants can outperform the standard CMA-ES, given that the dimension of the problem is large enough. In the second part, we define and exploit an experimental framework BBO Benchmarking (BBOB) in which practitioners of BBO can test and compare algorithms on function testbeds. Results show dependencies on the budget (number of function evaluations) assigned to the optimisation of the objective function. Some methods such as NEWUOA or BFGS are more appropriate for small budgets. The CMA-ES approach using restarts and a population size management policy performs well for larger budgets. The COmparing Continuous Optimisers (COCO) software, used for the BBOB, is described technically in the third part. COCO implements our experimental framework as well as outputs the results that we have been exploiting.
Document type :
Theses
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-00595922
Contributor : Raymond Ros <>
Submitted on : Wednesday, May 25, 2011 - 11:15:03 PM
Last modification on : Monday, December 9, 2019 - 5:24:06 PM
Long-term archiving on: Friday, November 9, 2012 - 12:11:14 PM

Identifiers

  • HAL Id : tel-00595922, version 1

Citation

Raymond Ros. Real-Parameter Black-Box Optimisation: Benchmarking and Designing Algorithms. Modeling and Simulation. Université Paris Sud - Paris XI, 2009. English. ⟨tel-00595922v1⟩

Share

Metrics

Record views

37

Files downloads

376