Elasticity in Parallel Sparse Triangular Solve
This paper introduces Stale Synchronous Parallel mode of execution for parallel sparse triangular linear system solve and presents a scheduler that achieves geometric-mean speed-ups of 7-30% over GrowLocal and 19-60% over SpMP on ARM and x86 machines respectively.
Proposes a new mode of execution called Stale Synchronous Parallel for parallel sparse triangular linear system solve and presents a scheduler that achieves significant speed-ups.
Before reading this…
Applications
- →Parallel computing
- →Linear algebra
To understand this paper, make sure you know these concepts first:
- Understanding of parallel computing conceptsfind papers →
- Linear algebrafind papers →
Abstract
More Like ThisWe introduce stale synchronous parallel as a mode of execution in parallel sparse triangular linear system solve and present a general directed-acyclic-graph scheduler capable of producing such schedules. Stale-synchronous-parallel schedules allow the overlap of synchronisation and compute which results in a geometric-mean speed-up of $7$-$30\%$ of our scheduler, ElasticDivide, over state-of-the-art synchronous scheduler GrowLocal on an ARM machine using 48 cores. On an x86 machine using 48 cores, we report geometric-mean speed-ups of $19$-$60\%$ over SpMP.