On the design of sparse hybrid linear solvers for modern parallel architectures

Stojce Nakov 1, 2
Abstract : In the context of this thesis, our focus is on numerical linear algebra, more precisely on solution of large sparse systems of linear equations. We focus on designing efficient parallel implementations of MaPHyS, an hybrid linear solver based on domain decomposition techniques. First we investigate the MPI+threads approach. In MaPHyS, the first level of parallelism arises from the independent treatment of the various subdomains. The second level is exploited thanks to the use of multi-threaded dense and sparse linear algebra kernels involved at the subdomain level. Such an hybrid implementation of an hybrid linear solver suitably matches the hierarchical structure of modern supercomputers and enables a trade-off between the numerical and parallel performances of the solver. We demonstrate the flexibility of our parallel implementation on a set of test examples. Secondly, we follow a more disruptive approach where the algorithms are described as sets of tasks with data inter-dependencies that leads to a directed acyclic graph (DAG) representation. The tasks are handled by a runtime system. We illustrate how a first task-based parallel implementation can be obtained by composing task-based parallel libraries within MPI processes throught a preliminary prototype implementation of our hybrid solver. We then show how a task-based approach fully abstracting the hardware architecture can successfully exploit a wide range of modern hardware architectures. We implemented a full task-based Conjugate Gradient algorithm and showed that the proposed approach leads to very high performance on multi-GPU, multicore and heterogeneous architectures.
Document type :
Theses
Complete list of metadatas

Cited literature [141 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01304315
Contributor : Abes Star <>
Submitted on : Tuesday, April 19, 2016 - 3:42:08 PM
Last modification on : Wednesday, April 4, 2018 - 1:24:20 AM
Long-term archiving on : Wednesday, July 20, 2016 - 1:08:16 PM

File

NAKOV_STOJCE_2015.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01304315, version 1

Citation

Stojce Nakov. On the design of sparse hybrid linear solvers for modern parallel architectures. Other [cs.OH]. Université de Bordeaux, 2015. English. ⟨NNT : 2015BORD0298⟩. ⟨tel-01304315⟩

Share

Metrics

Record views

340

Files downloads

493