Abstract This paper introduces cost curves, a graphical technique for visualizing the performance (error rate or expected cost) of 2-class classifiers over the full range of possible class distributions and misclassification costs. Cost curves are shown to be superior to ROC curves for visualizing classifier performance for most purposes. This is because they visually support several crucial types of performance assessment that cannot be done easily with ROC curves, such as showing confidence intervals on a classifier's performance, and visualizing the statistical significance of the difference in performance of two classifiers. A software tool supporting all the cost curve analysis described in this paper is available from the authors.
Drummond and Holte REF proposed a visualization technique called "Cost Curve", which is able to take into account of cost terms for showing confidence intervals on classifier's performance.
Cost curves: An improved method for visualizing classifier performance
Machine Learning
Machine Learning
Computer Science