fix long-standing spider bug causing some
ip queues to not get fully spidered.