Skip to Main content Skip to Navigation
Theses

Techniques d'Apprentissage par Renforcement pour le Routage Adaptatif dans les Réseaux de Télécommunication à Trafic Irrégulie

Said Hoceini
Abstract : The aim of this thesis is to propose an algorithmic approach, which allows to treat the problems of adaptive routing (AR) in telecommunication networks with irregular traffic. The analysis of the existing approaches has lead us to base our work on the Q-Routing (QR) algorithm. This algorithm uses a reinforcement learning technique which is based on Markov models. The efficiency of these routing approaches depends on information about the network load and the nature of data flows. This information must be sufficient and relevant and it has to reflect the real network load during the decision making phase. To overcome drawbacks of techniques using QR, we have proposed two AR algorithms. The first one, which is called Q-Neural Routing, is based on a stochastic neural model, used for parameter estimation and updating required for routing. In order to reduce the convergence time, a second approach is proposed: k-Shortest path Q-Routing. It is based on a multi-paths routing technique combined with the QR algorithm. In this case, the exploration space is limited to k-Best paths. The proposed algorithms are validated and compared to traditional approaches using the OPNET Simulator. Their efficiency, with respect to AR, is illustrated. In fact, these algorithms allow taking into account the network state in a better way than the classical approaches do.
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-00010430
Contributor : Said Hoceini <>
Submitted on : Wednesday, October 5, 2005 - 10:12:16 PM
Last modification on : Wednesday, December 14, 2005 - 10:52:27 PM
Long-term archiving on: : Friday, April 2, 2010 - 10:16:31 PM

Identifiers

  • HAL Id : tel-00010430, version 1

Citation

Said Hoceini. Techniques d'Apprentissage par Renforcement pour le Routage Adaptatif dans les Réseaux de Télécommunication à Trafic Irrégulie. Réseaux et télécommunications [cs.NI]. Université Paris XII Val de Marne, 2004. Français. ⟨tel-00010430⟩

Share

Metrics

Record views

358

Files downloads

2434