Skip to Main content Skip to Navigation
Theses

Influence du son lors de l’exploration de scènes naturelles dynamiques : Prise en compte de l’information sonore dans un modèle d’attention visuelle

Antoine Coutrot 1 
1 GIPSA-VIBS - GIPSA - Vision and Brain Signal Processing
GIPSA-DIS - Département Images et Signal
Abstract : We study the influence of different audiovisual features on the visual exploration of dynamic natural scenes. We show that, whilst the way a person explores a scene primarily relies on its visual content, sound sometimes significantly influences eye movements. Sound assures a better coherence between the eye posi- tions of different observers, attracting their attention and thus their gaze toward the same regions. The effect of sound is particularly strong in conversation scenes, where the related speech signal boosts the number of fixations on speakers’ faces, and thus increases the consistency between scanpaths. We propose an audiovisual saliency model able to automatically locate speakers’ faces so as to enhance their saliency. These results are based on the eye movements of 148 participants recorded on more than 75,400 frames (125 videos) in 5 different experimental conditions.
Complete list of metadata

https://tel.archives-ouvertes.fr/tel-01113073
Contributor : Antoine Coutrot Connect in order to contact the contributor
Submitted on : Wednesday, February 4, 2015 - 12:42:38 PM
Last modification on : Monday, March 21, 2022 - 9:06:02 AM
Long-term archiving on: : Sunday, April 16, 2017 - 8:21:21 AM

Identifiers

  • HAL Id : tel-01113073, version 1

Collections

Citation

Antoine Coutrot. Influence du son lors de l’exploration de scènes naturelles dynamiques : Prise en compte de l’information sonore dans un modèle d’attention visuelle. Sciences cognitives. Université de Grenoble-Alpes, 2014. Français. ⟨tel-01113073v1⟩

Share

Metrics

Record views

386

Files downloads

497