Abstract the Crawler, add citations skeleton, display better httpd error messages