fleshed out crawl data stats in model, controllers and tests