add robots.txt
exclude rewritten error paths, fix indentation
Merge branch 'robots' of https://github.com/stuartf/3akai-ux into robots
Removed /shared/oae/errors line from robots.txt