Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation

Ensuring availability and managing consistency in geo-replicated file systems

Vinh Tao Thanh 1 
1 Regal - Large-Scale Distributed Systems and Applications
LIP6 - Laboratoire d'Informatique de Paris 6, Inria de Paris
Abstract : Geo-distributed file systems suffer from high latency and network partitions. Because of this, and to ensure high availability, such systems typically commit updates locally, with no latency, and propagate them in the background. Such optimistic replication faces two major challenges: (i) detecting conflicts between concurrent updates and resolving them in a way meaningful for users, while maintaining system integrity invariants; and (ii) supporting legacy applications that are not prepared to deal with concurrency anomalies. Existing optimistic geo-distributed file systems fall short of addressing the challenges. For instance, Dropbox does not support hard links; Andrew File System fails on some concurrent renaming of directories; and all existing systems use automatic conflict resolution that violates the legacy POSIX semantics. We present our solution to the above problems in the design and implementation of a prototype geo-distributed file system, named Tofu. Its design includes a new session abstraction to support the legacy API, while allowing optimistic updates. Unlike previous approaches, our solution is based on a formal model covering all aspects of a Unix-like file system, including directories, inodes, hard links, etc. It is able to detect all conflicts on those data structures, and resolves them in a way that we believe users will find generally reasonable. Experiments show that Tofu is highly scalable, and incurs linear overhead, improving over existing academic and industrial systems.
Document type :
Complete list of metadata

Cited literature [87 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Monday, June 18, 2018 - 10:51:05 AM
Last modification on : Wednesday, June 8, 2022 - 12:50:05 PM
Long-term archiving on: : Wednesday, September 26, 2018 - 6:16:03 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01673030, version 2


Vinh Tao Thanh. Ensuring availability and managing consistency in geo-replicated file systems. Systems and Control [cs.SY]. Université Pierre et Marie Curie - Paris VI, 2017. English. ⟨NNT : 2017PA066521⟩. ⟨tel-01673030v2⟩



Record views


Files downloads