Here's an example of a robots.txt's content: User-agent: * Disallow: . This tell all crawlers they can access everything.