Skip to Main content Skip to Navigation
Theses

MULTIMODAL INTERACTION SEMANTIC ARCHITECTURE FOR AMBIENT INTELLIGENCE

Abstract : There still exist many fields in which ways are to be explored to improve the human-system interaction. These systems must have the capability to take advantage of the environment in order to improve interaction. This extends the capabilities of system (machine or robot) to better reach natural language used by human beings. We propose a methodology to solve the multimodal interaction problem adapted to several contexts by defining and modelling a distributed architecture relying on W3C standards and web services (semantic agents and input/output services) working in ambient intelligence environment. This architecture is embedded in a multi-agent system modelling technique. In order to achieve this goal, we need to model the environment using a knowledge representation and communication language (EKRL, Ontology). The obtained semantic environment model is used in two main semantic inference processes: fusion and fission of events at different levels of abstraction. They are considered as two context-aware operations. The fusion operation interprets and understands the environment and detects the happening scenario. The multimodal fission operation interprets the scenario, divides it into elementary tasks, and executes these tasks which require the discovery, selection and composition of appropriate services in the environment to accomplish various aims. The adaptation to environmental context is based on multilevel reinforcement learning technique. The overall architecture of fusion and fission is validated under our framework (agents, services, EKRL concentrator), by developing different performance analysis on some use cases such as monitoring and assistance in daily activities at home and in the town.
Document type :
Theses
Complete list of metadatas

Cited literature [703 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01832724
Contributor : Sébastien Dourlens <>
Submitted on : Sunday, July 8, 2018 - 8:13:30 PM
Last modification on : Friday, October 23, 2020 - 4:52:13 PM
Long-term archiving on: : Tuesday, October 2, 2018 - 8:17:17 AM

File

thesis.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-01832724, version 1

Collections

Citation

Sébastien Dourlens. MULTIMODAL INTERACTION SEMANTIC ARCHITECTURE FOR AMBIENT INTELLIGENCE. Artificial Intelligence [cs.AI]. Ministere de la Recherche et de l'Enseignement Superieur, 2012. English. ⟨tel-01832724⟩

Share

Metrics

Record views

128

Files downloads

619