Cheaper packed_remove implementation