when docid is banned do not print json/xml
cruft in the serps. was causing json
parsing errors.
Merge branch 'diffbot-testing' into diffbot
added the query reindex smoke test.
fixed a lot of related bugs.
nothing
Merge branch 'master' into testing
try new pdftohtml binary
donations link
Merge branch 'testing' of git@github.com:gigablast/open-source-search-engine into testing
added http server compression (gzip) stats.
remove import link.
added status count to collection nav bar key
at the bottom.
default ask for gzip to on
fix for sitenuminlinks logic so we
do not overwrite global-index imported
site pop info in tagdb
nothing
Merge branch 'diffbot-testing' into testing

Conflicts:
	PageResults.cpp
fix floater bug from reading hashtable off disk.
force use floaters if ! useRobots and is diffbot crawl.
added floater coll override switch.
cygwin fixes
make zobrist values the same across
cygwin and apple by explicitly listing
them in hashtab.cpp
undo hashtab change. too much overhead.
add <omitCount> stuff. fix getDocIds() recalls
when too many results invisible (dedupped etc.).
show in xml, json, html. provide link in html to
show omitted results.