Use covariance-weighted residuals in joint optimization.