add some more disallows to robots.txt view