Skip to Main content Skip to Navigation

Computer Vision Methods for Unconstrained Gesture Recognition in the Context of Sign Language Annotation

Abstract : This PhD thesis concerns the study of computer vision methods for the automatic recognition of unconstrained gestures in the context of sign language annotation. Generally the annotation of SL video corpus is man- ually performed by linguists or computer scientists experienced in SL. However manual annotation is error-prone, unreproducible and time consuming. In addition de quality of the results depends on the SL annotators knowledge. Associating annotator knowledge to image processing techniques facilitates the annotation task increasing robustness and speeding up the required time. We have studied some image processing techniques for assisting annotation. First of all we intend to detect the limits corresponding to the beginning and end of a sign. This annotation method requires several low level approaches for performing temporal segmentation and for extracting motion and hand shape features. First we propose a particle filter based approach for robustly tracking hand and face robust to occlusions. Then a segmentation method for extracting hand when it is in front of the face has been developed. Motion is used for segmenting signs and later hand shape is used to improve the results. Indeed hand shape allows to delete limits detected in the middle of a sign. Once signs have been segmented we proceed to the gloss recognition using lexical description of signs.
Document type :
Complete list of metadatas

Cited literature [255 references]  Display  Hide  Download
Contributor : Matilde Gonzalez Preciado <>
Submitted on : Friday, December 21, 2012 - 2:42:32 PM
Last modification on : Friday, October 23, 2020 - 4:41:44 PM
Long-term archiving on: : Sunday, December 18, 2016 - 8:29:43 AM


  • HAL Id : tel-00768440, version 1



Matilde Gonzalez Preciado. Computer Vision Methods for Unconstrained Gesture Recognition in the Context of Sign Language Annotation. Computation and Language [cs.CL]. Université Paul Sabatier - Toulouse III, 2012. English. ⟨tel-00768440⟩



Record views


Files downloads