DiffFactorizer: remove an unneeded test