Skip to Main content Skip to Navigation

A contribution to mouth structure segmentation in images towards automatic mouth gesture recognition

Abstract : This document presents a series of elements for approaching the task of segmenting mouth structures in facial images, particularly focused in frames from video sequences. Each stage is treated separately in different Chapters, starting from image pre-processing and going up to segmentation labeling post-processing, discussing the technique selection and development in every case. The methodological approach suggests the use of a color based pixel classification strategy as the basis of the mouth structure segmentation scheme, complemented by a smart pre-processing and a later label refinement. The main contribution of this work, along with the segmentation methodology itself, is based in the development of a color-independent label refinement technique. The technique, which is similar to a linear low pass filter in the segmentation labeling space followed by a nonlinear selection operation, improves the image labeling iteratively by filling small gaps and eliminating spurious regions resulting from a prior pixel classification stage. Results presented in this document suggest that the refiner is complementary to image pre-processing, hence achieving a cumulative effect in segmentation quality. At the end, the segmentation methodology comprised by input color transformation, preprocessing, pixel classification and label refinement, is put to test in the case of mouth gesture detection in images aimed to command three degrees of freedom of an endoscope holder.
Document type :
Complete list of metadatas

Cited literature [132 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Monday, January 7, 2013 - 12:27:54 PM
Last modification on : Friday, October 23, 2020 - 5:02:38 PM
Long-term archiving on: : Monday, April 8, 2013 - 11:21:24 AM


Version validated by the jury (STAR)


  • HAL Id : tel-00770660, version 1


Juan Bernardo Gómez-Mendoza. A contribution to mouth structure segmentation in images towards automatic mouth gesture recognition. Other. INSA de Lyon; Universidad nacional de Colombia, 2012. English. ⟨NNT : 2012ISAL0074⟩. ⟨tel-00770660⟩



Record views


Files downloads