Don't trigger 1-core assert when there are no chunks to work on.

This is a patch from IMVU that fixes an issue that we've run into with builds there using jcache.