Lots of functionality. Still makes pop connection for every page load and doesn't parse headers quite correctly
Blanket disallow robots.txt