HTTP utilities for crawling, logging and information gathering