Revert "EllipsoidFactor: look for speedup by keeping same unit vectors"

This reverts commit 077b3c0207804773870fe46ba151c367e3066fd8.