added diffbotHopcount parameter for diffbot crawl and bulk jobs, also updated PageCrawlbot.cpp
Merge pull request #29 from emmanuelcharon/diffbot-testing

added diffbotHopcount parameter for diffbot crawl and bulk jobs
fix core when top tree's setNumNodes
tried to allocate too many nodes.
fix gbfieldmatch:pageUrl:"http://...." query.
problem with the : in the http:// and problem
with Query.cpp converting pageUrl to lower case
when it was hashed as "pageUrl" in XmlDoc::hashFacet2().
Merge branch 'diffbot' into diffbot-testing
instructions update
rename diffbotHopcount to maxHops
Merge pull request #32 from emmanuelcharon/diffbot-testing

rename diffbotHopcount to maxHops
fix a couple of cores.
reduce memory usage significantly by not
pre-allocating some per-collection hashtables.
fix core
reduce mem usage in rdbmap. useful
for when there are thousands of tiny collections.
no longer piggyback gbfieldmatch: on facet termlists
because it needs to be super fast.
fix bad sprintf
added a couple more facet examples
default query intersection threads to on for now
fixes for repair/rebuild functionality.
more to come.
reduce log spam
fix rebuild code some more