Be more robust to affine matrices that have 0 on their diagonal.