yui/yui.github.com — pull request #1 by triptych (2013-06-14 19:04:00+00:00)
Title: Adding a robots.txt to stop search engines from crawling yui.github.com/yui2/

We don't want search engines to crawl outdated docs. After we turn off docs on YDN we want the YUI3 docs to rise to the top of the results. This robots.txt file helps prevent old YUI 2.x docs from showing up in search results.