Set worker limit based on config and worker pool size