Attempt to speed-up live upgrade

Let's go for concurrency since sequential stuff was so abysmally bad
on large deploys.