Which prosodic features contribute to the recognition of dramatic attitudes?

Adela Barbulescu (1, 2) , Rémi Ronfard (2) , Gérard Bailly (1)

1 GIPSA-CRISSP - GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing
2 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments

In this work we explore the capability of audiovisual prosodic features (such as fundamental frequency, head motion or facial expressions) to discriminate among different dramatic attitudes. We extract the audiovisual parameters from an acted corpus of attitudes and structure them as frame, syllable and sentence-level features. Using Linear Discriminant Analysis classifiers, we show that prosodic features present a higher discriminating rate at sentence-level. This finding is confirmed by the perceptual evaluation results of audio and/or visual stimuli obtained from the recorded attitudes.

Keywords: Perceptual correlates; Audiovisual expressive speech; Dramatic attitudes; Affective database

Domains: Graphics [cs.GR]; Multimedia [cs.MM]

Adela Barbulescu, Rémi Ronfard, Gérard Bailly. Which prosodic features contribute to the recognition of dramatic attitudes?. Speech Communication, 2017, 95, pp.78-86. ⟨10.1016/j.specom.2017.07.003⟩. ⟨hal-01643330⟩