EllipsoidFactor: update the contact points from the optimised ellipsoid