added new Disallow paths to robots.txt, closes #856