improve logging of ignore debugging
add post-only option to webcrawler
fixes for itemcache