robots.txt: s/User-agent/User-Agent/ (pedantry)
Add meta robots tag where possible

This is because robots.txt is apparently case-sensitive [1].

[1] https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt