update default robots.txt with current routes

It looks like the default robots.txt content hasn't been updated since 0.3 or even earlier.