Major code update and rewrote web crawler.
Merge resolved.