aIOLi : Contrôle, Ordonnancement et Régulation des Accès aux Données Persistantes dans les Environnements Multi-applicatifs Haute Performance

Adrien Lebre 1
1 MESCAL - Middleware efficiently scalable
ID-IMAG - Informatique et Distribution, Inria Grenoble - Rhône-Alpes
Abstract : Lots of scientific applications use and create vast amounts of data. Those often have specific ways to access data in non-sequential patterns (strided requests). To avoid performance loss, parallel I/O libraries such as ROMIO are often used to aggregate small separate requests into large contiguous ones. However, optimizations for a given applications are not aware of the whole set of interactions with other ones running at the same time on the cluster. As a consequence, most of the optimization work is lost because they will be disturbed by the other applications !

This document presents a software service, named aIOLi, whose role is to control, reschedule and regulate the whole set of interactions coming from all applications running simultaneously on a cluster. Besides, the traditional POSIX API is maintained and used.

In such a context, trade-off have to be found between performance, fairness and response time. To achieve this, an I/O scheduling algorithm together with a ''requests aggregator'' considering both application access patterns and global system load have been designed and merged into aIOLi. The aIOLi service consists of a new generic framework pluggable into any I/O file system.
Several concurrent runs of the IOR benchmarks show significant improvements on read accesses with regards to POSIX and ROMIO calls.
Liste complète des métadonnées

Cited literature [117 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-00128538
Contributor : Adrien Lebre <>
Submitted on : Thursday, February 1, 2007 - 4:28:04 PM
Last modification on : Wednesday, December 5, 2018 - 1:21:23 AM
Document(s) archivé(s) le : Friday, September 21, 2012 - 10:50:24 AM

Identifiers

  • HAL Id : tel-00128538, version 1

Collections

Citation

Adrien Lebre. aIOLi : Contrôle, Ordonnancement et Régulation des Accès aux Données Persistantes dans les Environnements Multi-applicatifs Haute Performance. Réseaux et télécommunications [cs.NI]. Institut National Polytechnique de Grenoble - INPG, 2006. Français. ⟨tel-00128538⟩

Share

Metrics

Record views

449

Files downloads

593