Robots.txt is a text file that allows a website to provide instructions to web-crawling bots.
It tells search engines like Google which parts of your website they can and cannot access when indexing your site.
That makes robots.txt a powerful tool for SEO and can also be used to ensure that certain pages do not appear in Google search results.