Fully remove the transform, don't just set to null