EllipsoidFactor: remove some unused optimisation variables