Skip to Main content Skip to Navigation

Towards Malleable Distributed Storage Systems: From Models to Practice

Abstract : The Cloud, with its pay-as-you-go model, gives the possibility of elastic resource management; users can claim and release resources as needed. This elasticity leads to financial and energetical cost reductions, and helps applications to cope with varying workloads.Distributed cloud and HPC applications processing large amounts of data are often co-located with a distributed storage system in order to ensure fast data accesses. Although many works have been proposed to dynamically rescale the processing part of such systems to match their workload, the storage is never considered as malleable (able to be dynamically rescaled) since moving massive amounts of data around is assumed to be too slow in practice. However, in recent years hardware and storage techniques have evolved and this assumption needs to be revisited.In this thesis, we present a study of the rescaling operations in distributed storage systems approached from different angles. We start by modeling the minimal duration of rescaling operations to estimate their potential speed. Then, we develop a benchmark to measure the viability of distributed storage system malleability on a given platform. Last, we implement a rescaling manager for distributed storage systems that decides and organizes the data transfers required during a rescaling operation.
Document type :
Complete list of metadata

Cited literature [153 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Friday, November 22, 2019 - 12:27:05 PM
Last modification on : Wednesday, August 5, 2020 - 3:50:42 AM


Version validated by the jury (STAR)


  • HAL Id : tel-02376032, version 1


Nathanaël Cheriere. Towards Malleable Distributed Storage Systems: From Models to Practice. Other [cs.OH]. École normale supérieure de Rennes, 2019. English. ⟨NNT : 2019ENSR0018⟩. ⟨tel-02376032⟩



Record views


Files downloads