simply implement crawling rate limits