fix floater bug from reading hashtable off disk.
force use floaters if ! useRobots and is diffbot crawl.