spotify/luigi — pull request #349 by daveFNbuck (2014-06-11 20:29:07+00:00)
Title: Adds a --lock-size parameter to control number of simultaneous commands

This allows users to specify --lock-size N in their luigi commands to ensure that no more than N copies of the same command can be run simultaneously. This allows a little more flexibility for allowing new jobs to be scheduled when there's a backlog while preventing too many simultaneous processes from running.