Skip to Main content Skip to Navigation
Theses

Influence du son lors de l’exploration de scènes naturelles dynamiques : prise en compte de l’information sonore dans un modèle d’attention visuelle

Abstract : We study the influence of different audiovisual features on the visualexploration of dynamic natural scenes. We show that, whilst the way a person explores a scene primarily relies on its visual content, sound sometimes significantly influences eye movements. Sound assures a better coherence between the eye positions of different observers, attracting their attention and thus their gaze toward the same regions. The effect of sound is particularly strong in conversation scenes, where the related speech signal boosts the number of fixations on speakers' faces, and thus increases the consistency between scanpaths. We propose an audiovisual saliency model able to automatically locate speakers' faces so as to enhance their saliency. These results are based on the eye movements of 148 participants recorded on more than 75,400 frames (125 videos) in 5 different experimental conditions.
Complete list of metadata

Cited literature [145 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01113073
Contributor : ABES STAR :  Contact
Submitted on : Wednesday, May 18, 2016 - 4:17:07 PM
Last modification on : Friday, March 25, 2022 - 9:44:37 AM

File

COUTROT_2014_archivage.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01113073, version 2

Collections

Citation

Antoine Coutrot. Influence du son lors de l’exploration de scènes naturelles dynamiques : prise en compte de l’information sonore dans un modèle d’attention visuelle. Traitement du signal et de l'image [eess.SP]. Université de Grenoble, 2014. Français. ⟨NNT : 2014GRENT119⟩. ⟨tel-01113073v2⟩

Share

Metrics

Record views

381

Files downloads

487