passed URL support and example formatted blog, and a robots.txt