Activity Recognition and Uncertain Knowledge in Video Scenes Applied to Health Care Monitoring

Rim Romdhane 1
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : This work deals with the problem of human activity recognition. It is greatly motivated by research in video activity understanding applied to the domain of health care monitoring. Research on activity recognition is receiving an increasing attention from the scientific community today. It is one of the most challenging problem in computer vision and artificial intelligence domains. The main goal of the current activity recognition research consists in recognizing and understanding short-term action and long-term complex activities. In this work, we propose two main contributions. The first contribution consists of an approach for video activity recognition that addresses the uncertainty management issues for accurate event detection. The second contribution consists in defining an ontology and a knowledge base for health care monitoring and in particular Alzheimer monitoring at hospital. The proposed activity recognition approach combines semantic modelling together with a probabilistic reasoning to cope with the errors of low-level detectors and to handle activity recognition uncertainty. The probabilistic recognition of activities is based on Bayesian probability theory which provides a consistent framework for dealing with uncertain knowledge. The proposed probabilistic constraint verification approach based on Gaussian probability model enforces the accuracy of the activity recognition algorithm. We work in close collaboration with clinicians to define an ontology and a knowledge base for Alzheimer monitoring at hospital. The defined ontology contains several concepts useful for health care. We also define a number of criteria which could be observed by camera sensors to allow detection of early symptoms of Alzheimer's disease. We validate the proposed algorithm on real-world videos. The experimental results show that the proposed activity recognition algorithm can successfully recognize activities with a high recognition rate. The obtained results for health care monitoring highlight the advantages of the use of the proposed approach as a support platform for clinicians to objectively measure patient performance and obtain a quantifiable assessment of instrumental activities of daily living and gait analysis.
Complete list of metadatas
Contributor : Rim Romdhane <>
Submitted on : Monday, March 31, 2014 - 11:13:20 AM
Last modification on : Thursday, January 11, 2018 - 4:19:45 PM
Long-term archiving on : Monday, April 10, 2017 - 6:42:16 AM


  • HAL Id : tel-00967943, version 1



Rim Romdhane. Activity Recognition and Uncertain Knowledge in Video Scenes Applied to Health Care Monitoring. Information Theory [cs.IT]. Université Nice Sophia Antipolis, 2013. English. ⟨tel-00967943⟩



Record views


Files downloads