Adjust down workers that have a tough time finding first share