Wow crawler now inserting into DB. Crawlers don't seen to be hitting every page. Fix later.