Avoid displaying the CM twice for binary classifiers.