Skip to Main content Skip to Navigation
Theses

Apprentissage spatial de corrélations multimodales par des mécanismes d'inspiration corticale

Mathieu Lefort 1
1 CORTEX - Neuromimetic intelligence
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : This thesis focuses on unifying multiple modal data flows that may be provided by sensors of an agent. This unification, inspired by psychological experiments like the ventriloquist effect, is based on detecting correlations which are defined as temporally recurrent spatial patterns that appear in the input flows. Learning of the input flow correlations space consists on sampling this space and generalizing these learned samples. This thesis proposed some functional paradigms for multimodal data processing, leading to the connectionist, generic, modular and cortically inspired architecture SOMMA (Self-Organizing Maps for Multimodal Association). In this model, each modal stimulus is processed in a cortical map. Interconnection of these maps provides an unifying multimodal data processing. Sampling and generalization of correlations are based on the constrained self-organization of each map. The model is characterised by a gradual emergence of these functional properties: monomodal properties lead to the emergence of multimodal ones and learning of correlations in each map precedes self-organization of these maps. Furthermore, the use of a connectionist architecture and of on-line and unsupervised learning provides plasticity and robustness properties to the data processing in SOMMA. Classical artificial intelligence models usually miss such properties.
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-01749206
Contributor : Mathieu Lefort <>
Submitted on : Friday, November 23, 2012 - 2:59:59 PM
Last modification on : Tuesday, December 18, 2018 - 4:40:21 PM
Long-term archiving on: : Sunday, February 24, 2013 - 3:52:30 AM

Identifiers

  • HAL Id : tel-01749206, version 2

Citation

Mathieu Lefort. Apprentissage spatial de corrélations multimodales par des mécanismes d'inspiration corticale. Réseau de neurones [cs.NE]. Université de Lorraine, 2012. Français. ⟨NNT : 2012LORR0106⟩. ⟨tel-01749206v2⟩

Share

Metrics

Record views

761

Files downloads

984