Major improvements. Added watch dog timer to children, improved UI updates, added fault tolerance and auto process restart. Improved beginning and end of crawl conditions. Added reference tracking for pages.