re-enable spidering if off because we missed
a crawlinfo reply from udp timed out.
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
simple fix for &token=... searches
if no &token= or &c= then use default collnum for searching
add some debug msgs
fix stack smash core when title is huge.
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
ask all hosts for ALL crawl info for ALL collections
when we first startup. pass in 'f' flag. use 'i' normally
to indicate 'incremental' to only send crawlinfos that changed.
fix for bad crawl info stats
turn off stack smash detection so it will get a seg fault and
save and dump core when stack gets smashed.
Merge branch 'diffbot-testing' into testing
use post op not get for site list pages since the site
list can be large.
fix parm offset  bug
fix buggy title:schmuck OR gbmin:offerPrice query.
Merge branch 'testing' into diffbot-testing
fix debug print statements
fix hanging when doing &stream=1 for
a federated search. hack it so it
thinks we got m_msg3a.m_numDocIds summaries
after we've printed what was requested.
so we don't waste time getting all the summaries.
this popped up for federated search because
we merged the msg3as into a single msg3a and had
an overabundance of docids.
debug log msgs
try to hack fix core when streaming html
results back.
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing