SEMrush checks your Robots.txt file after one hour or after 100 requests to re-check your robots.txt file and process its contents.