Remove some redundant controller stuff.
Disallow spidering in robots.txt

As per https://www.gov.uk/service-manual/operations/operating-servicegovuk-subdomains.html#robotstxt-and-root-level-redirections