if crawlbot, do not overwrite sitenuminlinks stuff
in tagdb, because we imported that from big se.
fix for diffbot. use objects not results
for global-index.
Merge branch 'testing' into diffbot-testing
Merge branch 'testing' into diffbot-testing
Merge branch 'diffbot-testing' of github.com:gigablast/open-source-search-engine into diffbot-testing
git ride of select on writefds. pretty pointless unless
we tried to write to a socket before and the buffer was full
so the write failed. then we'd want to know if it was ready for writing
again i guess.... anyway i'm not so sure that happens a lot so i took it
out and i guess we'll see what happens. also added more udp/loop
debugging statements.