Clean up running dir jobs