* crawler now also returns header and redirect information with empty
content
* fixed additional (redirect page) storage in web page collection
* minor fixes