Changed tld.DetectDomainAndTLD to return the domain with subdomains trimmed. Changed the whois/dispatcher to be a singleton and added functions to add work by a query string or a domain (for the crawler). This meant changing whois/worker/work.
Added crawler and changed the way we get database config.