alphagov/frontend — pull request #69 by jystewart (2012-10-08 19:53:19+00:00)
Title: Robots first pass

First pass at a robots.txt for GOV.UK. This should be sufficient but **before we merge it** we'll need to verify that /*/print is valid - the spec is out of date and I've not had a chance to get into the Google Webmaster Tools to check that they'll accept it.