Skip to Main content Skip to Navigation

Modélisation Bayésienne d'une boucle perception-action : application à la lecture et à l'écriture

Estelle Gilet 1 
1 E-MOTION - Geometry and Probability for Motion and Action
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : How can the motor system influence perception ? How can the same movements be performed with different effectors ? In order to examine these questions, which are relevant in cognitive sciences, we studied the sensorimotor system involved in tasks of reading and writing isolated handwritten cursive letters. Our contribution is a formal model of this sensorimotor loop, that takes into account experimental findings as well as state-of-the-art theories. Our main hypothesis is the existence of an internal encoding of letters that is common to both perception and action. This encoding is assumed to be independent of the space of the effectors' joints. It acts as a pivot between perception and action models, and is made of sequences of geometrically salient control point. These are extracted from trajectories of handwritten letters and allow to recover part of the kinematic information. The formalism we used in this work is called Bayesian Programming. It allows to represent and manipulate incomplete and uncertain information using probabilities ; models are defined by specifying joint probability distributions. Given the joint probability distribution, the model can solve several cognitive tasks. Each of these corresponds to a probabilistic question that is automatically solved by Bayesian inference : reading, reading with an internal simulation of the writing gesture, trace copy and letter copy, writer recognition, writing using different effectors. We have implemented and simulated each of these probabilistic inferences. Our results reproduce observations from psychophysics experiments. Our model also suggests new experimental protocols, which we defined.
Document type :
Complete list of metadata

Cited literature [139 references]  Display  Hide  Download
Contributor : Estelle Gilet Connect in order to contact the contributor
Submitted on : Tuesday, November 10, 2009 - 10:57:29 AM
Last modification on : Sunday, June 26, 2022 - 4:55:57 AM
Long-term archiving on: : Tuesday, October 16, 2012 - 1:35:09 PM


  • HAL Id : tel-00430866, version 1



Estelle Gilet. Modélisation Bayésienne d'une boucle perception-action : application à la lecture et à l'écriture. Modélisation et simulation. Université Joseph-Fourier - Grenoble I, 2009. Français. ⟨tel-00430866⟩



Record views


Files downloads