Skip to Main content Skip to Navigation

Discovering and exploiting the task hierarchy to learn sequences of motor policies for a strategic and interactive robot

Abstract : Efforts are made to make robots operate more and more in complex unbounded ever-changing environments, alongside or even in cooperation with humans. Their tasks can be of various kinds, can be hierarchically organized, and can also change dramatically or be created, after the robot deployment. Therefore, those robots must be able to continuously learn new skills, in an unbounded, stochastic and high-dimensional space. Such environment is impossible to be completely explored during the robot's lifetime, therefore it must be able to organize its exploration and decide what is more important to learn and how to learn it, using metrics such as intrinsic motivation guiding it towards the most interesting tasks and strategies. This becomes an even bigger challenge, when the robot is faced with tasks of various complexity, some requiring a simple action to be achieved, other needing a sequence of actions to be performed. We developed a strategic intrinsically motivated learning architecture, called Socially Guided Intrinsic Motivation for Sequences of Actions through Hierarchical Tasks (SGIM-SAHT), able to learn the mapping between its actions and their outcomes on the environment. This architecture, is capable to organize its learning process, by deciding which outcome to focus on, and which strategy to use among autonomous and interactive ones. For learning hierarchical set of tasks, the architecture was provided with a framework, called procedure framework, to discover and exploit the task hierarchy and combine skills together in a task-oriented way. The use of sequences of actions enabled such a learner to adapt the complexity of its actions to that of the task at hand.
Complete list of metadata

Cited literature [74 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Friday, September 6, 2019 - 4:00:15 PM
Last modification on : Wednesday, October 14, 2020 - 4:09:38 AM
Long-term archiving on: : Thursday, February 6, 2020 - 9:10:21 PM


Version validated by the jury (STAR)


  • HAL Id : tel-02280809, version 1


Nicolas Duminy. Discovering and exploiting the task hierarchy to learn sequences of motor policies for a strategic and interactive robot. Computer science. Université de Bretagne Sud, 2018. English. ⟨NNT : 2018LORIS513⟩. ⟨tel-02280809⟩



Record views


Files downloads