The Robots.txt file is an text file that sits in the root of your website. For example https://compare.parts/robots.txt.
This robots.txt file contains instructions for search engines crawlers, such as areas of the sites they are and aren’t permitted to visit.
Editing a robots.txt file should be undertaken by an experience SEO only, if configured incorrectly your entire website can dissapear from search engines!
If you need help configuring your XML Sitemap, please get in touch with an SEO expert