Méthodes des moments pour l'inférence de systèmes séquentiels linéaires rationnels

Hadrien Glaude 1, 2, 3, 4
Abstract : Learning stochastic models generating sequences has many applications in natural language processing, speech recognitions or bioinformatics. Multiplicity Automata (MA) are graphical latent variable models that encompass a wide variety of linear systems. In particular, they can model stochastic languages, stochastic processes and controlled processes. Traditional learning algorithms such as the one of Baum-Welch are iterative, slow and may converge to local optima. A recent alternative is to use the Method of Moments (MoM) to design consistent and fast algorithms with pseudo-PAC guarantees. However, MoM-based algorithms have two main disadvantages. First, the PAC guarantees hold only if the size of the learned model corresponds to the size of the target model. Second, although these algorithms learn a function close to the target distribution, most do not ensure it will be a distribution. Thus, a model learned from a finite number of examples may return negative values or values that do not sum to one. This thesis addresses both problems. First, we extend the theoretical guarantees for compressed models, and propose a regularized spectral algorithm that adjusts the size of the model to the data. Then, an application in electronic warfare is proposed to sequence of the dwells of a superheterodyne receiver. Finally, we design new learning algorithms based on the MoM that do not suffer the problem of negative probabilities. We show for one of them pseudo-PAC guarantees.
Complete list of metadatas

Cited literature [157 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01374080
Contributor : Hadrien Glaude <>
Submitted on : Thursday, September 29, 2016 - 4:40:30 PM
Last modification on : Friday, May 17, 2019 - 11:39:00 AM
Long-term archiving on : Friday, December 30, 2016 - 2:20:17 PM

Identifiers

  • HAL Id : tel-01374080, version 1

Citation

Hadrien Glaude. Méthodes des moments pour l'inférence de systèmes séquentiels linéaires rationnels. Apprentissage [cs.LG]. Université de Lille 1 - Sciences et Technologies, 2016. Français. ⟨tel-01374080⟩

Share

Metrics

Record views

711

Files downloads

836