simply implement crawling rate limits

Simply implement crawling rate limits.