Move the Semaphore up to be scoped to the WorkPool. If any WorkQueue aka channel is unlimited then they all are.