Specialize rehashing for when we have no filled elements