This class is less useful now, since the PrioritySchedulerLimiter extends the SchedulerLimiter instead of this, we could just move all this code into the ExecutorLimiter.  I just avoided that for now to keep the code change smaller.