fix spiderrequest deduping some more