update robots.txt

There is probably a billion better ways to do this but I disallowed
misc directories that are not supposed to be googleable