BBC/Wally — comment on commit 0ede5fbd77f0a6dbf270f8bfa2e082a4dd01988c
File:  line 0
By AndrewVos:

This has been in my todo list for a while now :/

We might want to read the robots.txt file in from the directory that wally is executed from, so that people can use their own robots.txt.