Skip to Main content Skip to Navigation
Theses

Broadening the scope of gaussian processes for large-scale learning

Abstract : The renewed importance of decision making under uncertainty calls for a re-evaluation of Bayesian inference techniques targeting this goal in the big data regime. Gaussian processes (GPs) are a fundamental building block of many probabilistic kernel machines; however, the computational and storage complexity of GPs hinders their scaling to large modern datasets. The contributions presented in this thesis are two-fold. We first investigate the effectiveness of exact GP inference on a computational budget by proposing a novel scheme for accelerating regression and classification by way of preconditioning. In the spirit of probabilistic numerics, we also show how the numerical uncertainty introduced by approximate linear algebra should be adequately evaluated and incorporated. Bridging the gap between GPs and deep learning techniques remains a pertinent research goal, and the second broad contribution of this thesis is to establish and reinforce the role of GPs, and their deep counterparts (DGPs), in this setting. Whereas GPs and DGPs were once deemed unfit to compete with alternative state-of-the-art methods, we demonstrate how such models can also be adapted to the large-scale and complex tasks to which machine learning is now being applied.
Complete list of metadata

Cited literature [190 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-02968227
Contributor : Abes Star :  Contact
Submitted on : Thursday, October 15, 2020 - 3:09:24 PM
Last modification on : Monday, December 14, 2020 - 9:53:02 AM

File

CUTAJAR_Kurt_2019.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-02968227, version 1

Citation

Kurt Cutajar. Broadening the scope of gaussian processes for large-scale learning. Machine Learning [cs.LG]. Sorbonne Université, 2019. English. ⟨NNT : 2019SORUS063⟩. ⟨tel-02968227⟩

Share

Metrics

Record views

67

Files downloads

51