Implemented referer check to enable adapters to preserve crawling depth.
Overall dispatch stats for multi-dispatch crawl operations.
Updated sample adapters.