This is kind of a mess right now. It needs to know the number of jobs the `build_all` task will actually kick off, which is kind of difficult to know without duplicating some code. If it were easier to decouple the `build_count` from the job we're wrapping I could abstract a lot of this and making `managed_*` jobs would be super easy.