fixed error in readme example
updated deps
updated deps
Merge remote-tracking branch 'clojens/master'
indention fix
initial robots.txt handler added
added polite? option to config
politeness docs updated
Merge branch 'pr/5'
Whitespace fixes