Instead of robot, it's better use different branch, see http://stackoverflow.com/questions/15844905/how-to-stop-google-indexing-my-github-repository