contao/core — pull request #6992 by xchs (2014-05-12 22:42:00+00:00)
Title: Update `robots txt`

In the upcoming next minor version we'll deliver a few new build and configuration files (which are directly accessible via HTTP).

In order to prevent those files from being crawled by search engines, it might be a good idea to add the following entries to our `robots.txt` file:
```
Disallow: /build.xml
Disallow: /composer.json
Disallow: /composer.lock
```