SC20 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

TaskTorrent: A Lightweight Distributed Task-Based Runtime System in C++


Workshop:PAW-ATM 2020: The 3rd Annual Parallel Applications Workshop, Alternatives To MPI+X

Authors: Léopold Cambier, Yizhou Qian, and Eric Darve (Stanford University)


Abstract: We present TaskTorrent, a lightweight distributed task-based runtime in C++. TaskTorrent uses a parametrized task graph to express the task DAG, and one-sided active messages to trigger remote tasks asynchronously. As a result, the task DAG is completely distributed and discovered in parallel. It is a C++14 library and only depends on MPI. We explain the API and the implementation. We perform a series of benchmarks against StarPU and ScaLAPACK. Micro benchmarks show it has a minimal overhead compared to other solutions. We then apply it to two large linear algebra problems. TaskTorrent scales very well to thousands of cores, exhibiting good weak and strong scalings.


Website:






Back to PAW-ATM 2020: The 3rd Annual Parallel Applications Workshop, Alternatives To MPI+X Archive Listing



Back to Full Workshop Archive Listing