compute the affine decomposition (and stock matrices) only if we don't want to use operators free