Disallow web crawlers in robots.txt. Fixes #197