alphagov/static — pull request #62 by jystewart (2012-10-08 19:59:58+00:00)
Title: robots.txt for GOV.UK

First pass at this but probably sufficient to launch with.

I had put it in frontend, but it probably belongs in static. Helpfully that's where the site is already configured to look for it.

**Do not merge yet** we need to verify that /*/print is valid syntax as far as modern day web crawlers (or at least google) are concerned.