This fixes #85
Our logic was flipped for checking if we needed to look to add workers.  In addition we had an off by one for adding those workers, as well as prestarting the core threads.
I also found a small optimization chance to reduce the clock lookups when trying to get get an existing worker.