Skip to Main content Skip to Navigation

Numerical Methods and Deep Learning for Stochastic Control Problems and Partial Differential Equations

Abstract : The present thesis deals with numerical schemes to solve Markov Decision Problems (MDPs), partial differential equations (PDEs), quasi-variational inequalities (QVIs), backward stochastic differential equations (BSDEs) and reflected backward stochastic differential equations (RBSDEs). The thesis is divided into three parts. The first part focuses on methods based on quantization, local regression and global regression to solve MDPs. Firstly, we present a new algorithm, named Qknn, and study its consistency. A time-continuous control problem of market-making is then presented, which is theoretically solved by reducing the problem to a MDP, and whose optimal control is accurately approximated by Qknn. Then, a method based on Markovian embedding is presented to reduce McKean-Vlasov control problem with partial information to standard MDP. This method is applied to three different McKean- Vlasov control problems with partial information. The method and high accuracy of Qknn is validated by comparing the performance of the latter with some finite difference-based algorithms and some global regression-based algorithm such as regress-now and regress-later. In the second part of the thesis, we propose new algorithms to solve MDPs in high-dimension. Neural networks, combined with gradient-descent methods, have been empirically proved to be the best at learning complex functions in high-dimension, thus, leading us to base our new algorithms on them. We derived the theoretical rates of convergence of the proposed new algorithms, and tested them on several relevant applications. In the third part of the thesis, we propose a numerical scheme for PDEs, QVIs, BSDEs, and RBSDEs. We analyze the performance of our new algorithms, and compare them to other ones available in the literature on several tests, which illustrates the efficiency of our methods to estimate complex solutions in high-dimension.
Document type :
Complete list of metadata

Cited literature [124 references]  Display  Hide  Download
Contributor : Côme Huré Connect in order to contact the contributor
Submitted on : Thursday, October 24, 2019 - 1:25:09 PM
Last modification on : Friday, August 5, 2022 - 3:00:05 PM
Long-term archiving on: : Saturday, January 25, 2020 - 3:55:59 PM


Files produced by the author(s)


  • HAL Id : tel-02331441, version 1


Côme Huré. Numerical Methods and Deep Learning for Stochastic Control Problems and Partial Differential Equations. Mathematics [math]. Université Paris Diderot (Paris 7), Sorbonne Paris Cité, 2019. English. ⟨tel-02331441⟩



Record views


Files downloads