ENH: add more checks to make sure workers do not run the same job