Fixed crawler to be more distributed