return error if client tries to use https for squid proxy
right now.
Enable facets for site
Merge pull request #23 from miketung/diffbot-testing

Enable facets for site
added some debug logic. (will remove shortly)
fix for mike's commit.
distribute diffbot proxy requests over all hosts.
remove debug prints
Remove mobile user-agents to prevent fetching mobile version of page.
Merge pull request #24 from miketung/diffbot-testing

Remove mobile user-agents to prevent fetching mobile version of page.
remove log debug msg
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
fix squid proxy balancing code some more.
fix death queries when msg2 had docs wanted of 0
because all termlists were empty.
fix &n=10000000 fix some more
fix EXTREMELY slow unlinks and file renames on
morpheus because of sync() cmd.
added query debug msgs for allocating
TopNodes in TopTree.
User needs to specify seeds to create a crawlbot crawl.  This fixes 2110.
Merge pull request #26 from miketung/diffbot-testing

User needs to specify seeds to create a crawlbot crawl.  This fixes 2110...
add 2nd collection passwords link
fix OOM condition a bit
check for "urls" as well as "seeds" cgi parms
before creating collection.
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing