modified hopcount computation for custom crawls
fix injection stuff
do not spam the logs with spider request corrupt count msgs.
but store a count for them now in coll rec.
show language query synonym terms came from
in the xml/json feed.
nomenclature change
print query info in json, too, not just xml
on bad hint offset do not core, just return corrupt data errno.
if its a diffbot crawl/bulk job then do not use
linkdb to save disk space.
show spider req/repl sizes added to spiderdb in logIt().
make 'make' by itself work on 32-bit archs again.
show how long it took in html serps
fix tld lang url filter. was being reset.
Merge pull request #35 from emmanuelcharon/diffbot-testing

modified hopcount computation for custom crawls
identation cleanups
remove type long, replace with int32_t