linkedin/glu — pull request #146 by zsimic (2012-06-08 00:53:00+00:00)
Title: Glu3 wip

We tried to deploy in parallel to 3000 machines, and that choked a couple of systems relied upon by the agents (zookeeper and artifactory). This is a modification that allows to configure GLU so it doesn't try to perform more than a given number of parallel deployments.
Any large parallel deployment requests are split up in buckets of the specified maximum (when specified), and then these buckets are deployed sequentially,

Example: if the limit is 500 max parallel deployments, and a request comes in for 1300 parallel deployments, glu will proceed as follows:
- deploy the first 500 requests, wait until they're all done
- deploy the next 500 requests, wait until they're all done
- deploy the final 300 requests, wait until they're all done
- wrap up the deployment