Crawlrecord status and bug fix

Removed pool shutdown on crawl failure so that subsequent crawls will
still run.
Added status to crawl record list display.