reuse cholesky factors in fit