De l'indexation d'évènements dans des films : application à la détection de violence

Cédric Penet 1
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : In this thesis, we focus on the detection of semantic concepts in "Hollywood" movies using audio and video concepts for the detection of violence. We present experiments in two main areas : the detection of violent audio concepts such as gunshots and explosions, and the detection of violence, initially based only on audio, then based on both audio and video. In the context of audio concepts detection, we first show a generalisation arising between movies. We show that this problem is probably due to a statistical divergence between the audio features extracted from the movies. In order to solve it, we propose to use the concept of audio words, so as to reduce the variability by grouping samples by similarity, combined with contextual Bayesian networks. The results are very encouraging, and a comparison with the state of the art obtained on the same data shows that the results we obtain are equivalent. The resulting system can be either robust against the threshold applied by using early fusion of features, or provides a wide variety of operating points. We finally propose an adaptation of the factor analysis scheme developed in the context of speaker recognition, and show that its integration into our system improves the results. In the context of the detection of violence, we present the Mediaeval Affect Task 2012 evaluation campaign, which aims at bringing together teams working on the topic of violence detection. We then propose three systems for detecting the violence. The first two are based only on audio, the first using a TF-IDF description, and the second being the integration of the previous system for the detection violence. The last system we present is a multimodal system based on Bayesian networks that allows us to explore structure learning algorithms for graphs. The performance obtained in the different systems, and a comparison to the systems developed within Mediaeval, show that we are comparable to the state of the art, and show the complexity of such systems.
Document type :
Theses
Complete list of metadatas

Cited literature [149 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-00909117
Contributor : Abes Star <>
Submitted on : Thursday, April 24, 2014 - 4:42:09 PM
Last modification on : Friday, November 16, 2018 - 1:31:29 AM
Long-term archiving on : Thursday, July 24, 2014 - 11:40:16 AM

File

PENET_Cedric.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-00909117, version 2

Citation

Cédric Penet. De l'indexation d'évènements dans des films : application à la détection de violence. Autre [cs.OH]. Université Rennes 1, 2013. Français. ⟨NNT : 2013REN1S145⟩. ⟨tel-00909117v2⟩

Share

Metrics

Record views

446

Files downloads

519