Added time delay to crawler with round robin over domains