Towards Malleable Distributed Storage Systems: From Models to Practice

Abstract : The Cloud, with its pay-as-you-go model, gives the possibility of elastic resource management; users can claim and release resources as needed. This elasticity leads to financial and energetical cost reductions, and helps applications to cope with varying workloads.Distributed cloud and HPC applications processing large amounts of data are often co-located with a distributed storage system in order to ensure fast data accesses. Although many works have been proposed to dynamically rescale the processing part of such systems to match their workload, the storage is never considered as malleable (able to be dynamically rescaled) since moving massive amounts of data around is assumed to be too slow in practice. However, in recent years hardware and storage techniques have evolved and this assumption needs to be revisited.In this thesis, we present a study of the rescaling operations in distributed storage systems approached from different angles. We start by modeling the minimal duration of rescaling operations to estimate their potential speed. Then, we develop a benchmark to measure the viability of distributed storage system malleability on a given platform. Last, we implement a rescaling manager for distributed storage systems that decides and organizes the data transfers required during a rescaling operation.
Document type :
Theses
Complete list of metadatas

Cited literature [153 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-02376032
Contributor : Abes Star <>
Submitted on : Friday, November 22, 2019 - 12:27:05 PM
Last modification on : Tuesday, February 25, 2020 - 8:08:10 AM

File

2019ENSR0018_Thesis_CHERIERE.p...
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-02376032, version 1

Citation

Nathanaël Cheriere. Towards Malleable Distributed Storage Systems: From Models to Practice. Other [cs.OH]. École normale supérieure de Rennes, 2019. English. ⟨NNT : 2019ENSR0018⟩. ⟨tel-02376032⟩

Share

Metrics

Record views

391

Files downloads

79