add some debug notes
support gbmin gbmax gbminint gbmaxint range query
terms properly, when generating the docidvotebuf.
fixes boolean queries using them as well.
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
more debug msgs
sanity checks to ensure fakefirstip
was able to convert to a real good firstip
print error stuff in spiderdb dump.
fix issue of not retrying diffbot internal errors.
no longer for add www to url domain if it is just
a domain. was messing of tmblr.co where www.tmblr.co
has no IP.
more mem leak fixes for fake
bulk job empty http replies
more fixes for fake http reply hack
fix merging getting clogged by so many
collections tring to merge tagdb at once
fix to rename tagdb0000.002.dat
bulk jobs give up after downloading a url
3 times. crawls don't give up on tmperrors,
but retry every 30 days.
try to prevent job status flip flop from error retries.
log format change for errcnt
fixes for gbmin/gbmax being first query term.
do not truncate crawl jobs POSTs
any /admin/ cmd as well should not trunc posts
fix domain only bug in serps
Merge branch 'diffbot-testing' into testing