Skip to Main content Skip to Navigation

Evaluation et rééducation des expressions faciales émotionnelles chez l’enfant avec TSA : le projet JEMImE

Abstract : The autism spectrum disorder (ASD) is characterized by difficulties in socials skills, as emotion recognition and production. Several studies focused on emotional facial expressions (EFE) recognition, but few worked on its production, either in typical children or in children with ASD. Nowadays, information and communication technologies are used to work on social skills in ASD but few studies using these technologies focus on EFE production. After a literature review, we found only 4 games regarding EFE production. Our final goal was to create the serious game JEMImE to work on EFE production with children with ASD using an automatic feedback. We first created a dataset of EFE of typical children and children with ASD to train an EFE recognition algorithm and to study their production skills. Several factors modulate them, such as age, type of emotion or culture. We observed that human judges and the algorithm assess the quality of the EFE of children with ASD as poorer than the EFE of typical children. Also, the EFE recognition algorithm needs more features to classify their EFE. We then integrated the algorithm in JEMImE to give the child a visual feedback in real time to correct his/her productions. A pilot study including 23 children with ASD showed that children are able to adapt their productions thanks to the feedback given by the algorithm and illustrated an overall good subjective experience with JEMImE. The beta version of JEMImE shows promising potential and encourages further development of the game in order to offer longer game exposure to children with ASD and so allow a reliable assessment of the effect of this training on their production of EFE.
Complete list of metadata
Contributor : Abes Star :  Contact
Submitted on : Monday, September 20, 2021 - 6:48:13 PM
Last modification on : Monday, December 6, 2021 - 4:30:07 PM


Version validated by the jury (STAR)


  • HAL Id : tel-03349860, version 1


Charline Grossard. Evaluation et rééducation des expressions faciales émotionnelles chez l’enfant avec TSA : le projet JEMImE. Informatique. Sorbonne Université, 2019. Français. ⟨NNT : 2019SORUS625⟩. ⟨tel-03349860⟩



Record views


Files downloads