dup cache fixes. do not add dups to spiderdb either.