Improved methods for divisible load distribution on k-dimensional meshes using pipelined communications
We give the closed form solutions to the parallel time and speedup of the classic method for processing divisible loads on linear arrays as functions of N, the network size. We propose two methods which employ pipelined communications to distribute divisible loads on linear arrays. We derive the closed form solutions to the parallel time and speedup for both methods and show that the asymptotic speedup of both methods is beta + 1, where beta is the ratio of the time for computing a unit load to the time for communicating a unit load. Such performance is even better than that of the known methods on k-dimensional meshes with k > 1. The two new algorithms which use pipelined communications are generalized to distribute divisible loads on k-dimensional meshes, and we show that the asymptotic speedup of both algorithms is kbeta + 1, where k greater than or equal to 1. We also prove that, on k-dimensional meshes where k greater than or equal to 1, as the network size becomes large, the asymptotic speedup of 2kbeta + 1 can be achieved for processing divisible loads by using interior initial processors.
divisible load load distribution pipelined communication speedup linear array performance analysis