Disallow subpages for bots
Merge pull request #197 from stianjensen/robots-txt-update

Disallow subpages for bots