Modélisation et détection des émotions à partir de données expressives et contextuelles

Franck Berthelon 1
1 WIMMICS - Web-Instrumented Man-Machine Interactions, Communities and Semantics
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems
Abstract : We present a computational model for emotion detection based on human behavioural expression. For this work, we use the two-factor theory of Schachter and Singer to map our architecture onto natural behavior, using both expressive and contextual data to build our emotion detector. We focus our effort on expression interpretation by introducing Personalized Emotion Maps (PEMs), and on emotion contextualisation via an Emotion Ontology for Contex Awareness (EmOCA). PEMs are motivated by Scherer’s complex system model of emotions and represent emotion values determined from multiple sensors. PEMs are calibrated to individuals, then a regression algorithm uses individual-specific PEMs to determine a person’s emotional feeling from sensor measurements of their bodily expressions. The aim of this architecture is to dissociate expression interpretation from sensor measurements, thus allowing flexibility in the choice of sensors. Moreover, PEMs can also be used in facial expression synthesis. EmOCA brings context into the emotion-modulating cognitive input to weight predicted emotion. We use a well known interoperable reasoning tool, an ontology, allowing us to describe and to reason about philia and phobia in order to modulate emotion determined from expression. We present a prototype using facial expressions to evaluate emotion recognition from real-time video sequences. Moreover, we note that, interestingly, the system detects the sort of hysteresis phenomenon in changing emotion state as suggested by Scherer’s psychological model.
Document type :
Theses
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-00917416
Contributor : Abes Star <>
Submitted on : Thursday, February 6, 2014 - 5:33:23 PM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Long-term archiving on: Sunday, April 9, 2017 - 9:42:19 AM

File

2013NICE4151.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-00917416, version 2

Collections

Citation

Franck Berthelon. Modélisation et détection des émotions à partir de données expressives et contextuelles. Autre [cs.OH]. Université Nice Sophia Antipolis, 2013. Français. ⟨NNT : 2013NICE4151⟩. ⟨tel-00917416v2⟩

Share

Metrics

Record views

1707

Files downloads

16630