A fundamental question that shrouds the emergence of massively parallel computing (MPC) platforms is how can the additional power of the MPC paradigm (more local storage and computational power) be leveraged to achieve faster algorithms compared to classical parallel models such as PRAM? Previous research has identified the sparse graph connectivity problem as a major obstacle to such improvement: While classical logarithmic-round PRAM algorithms for finding connected components in any n-vertex graph have been known for more than three decades, no o(log n)-round MPC algorithms are known for this task with truly sublinear in n memory per machine. This problem arises when processing massive yet sparse graphs with O(n) edges, for which the interesting setting of parameters is n 1−Ω(1) memory per machine. It is conjectured that achieving an o(log n)-round algorithm for connectivity on general sparse graphs with n 1−Ω(1) per-machine memory may not be possible, and this conjecture also forms the basis for multiple conditional hardness results on the round complexity of other problems in the MPC model. In this paper, we take an opportunistic approach towards the sparse graph connectivity problem, by designing an algorithm with improved performance guarantees in terms of the connectivity structure of the input graph. Formally, we design an MPC algorithm that finds all connected components with spectral gap at least λ in a graph in O(log log n + log (1/λ)) MPC rounds and n Ω(1) memory per machine. While this algorithm still requires Ω(log n) rounds in the worst-case when components are "weakly" connected (i.e., λ ≈ 1/n), it achieves an exponential round reduction on sparse "well-connected" components (i.e., λ ≥ 1/polylog(n)) using only n Ω(1) memory per machine and O(n) total memory, and still operates in o(log n) rounds even when λ = 1/n o(1) . To best of our knowledge, this is the first non-trivial (and indeed exponential) improvement in the round complexity over PRAM algorithms, for a natural class of sparse connectivity instances.
More relevant to our work on graph connectivity, a recent result by Assadi et al. REF implies an O(log 1 λ + log log n) round algorithm for graphs with O(n) edges that have spectral gap at least λ.
Massively Parallel Algorithms for Finding Well-Connected Components in Sparse Graphs
ArXiv
ArXiv
Computer Science Mathematics