Reduce chance of workers deadlocking

Removed failed job retrying and job priority

[#84346198]