Simple scheduler for dealing with batch requests that can't be started all at once.