Some code that I use to crawl the web, released in the spirit of jolly cooperation