A spline-based tool to assess and visualize the calibration of multiclass risk predictions
Generic calibration tools for multiclass risk models are proposed. Calibration plots visualize the reliability of the predicted risks. Estimated calibration index (ECI) quantifies the lack of calibration. More attention for calibration in machine learning research is required.
auc area under the roc curve ci confidence interval eci estimated calibration index iota international ovarian tumor analysis iqr interquartile range knn k nearest neighbor lr-bt logistic regression binary tree - sequential dichotomous model to binary tree sequential dichotomous logistic regression lr-pc pairwise coupling logistic regression mlr multinomial logistic regression nb naive bayes nsc nearest shrunken centroids pdi polytomous discrimination index rf random forest roc receiver operating characteristic svm support vector machines svm-bt support vector machines binary tree - sequential dichotomous model to binary tree sequential dichotomous support vector machines svm-pc pairwise coupling support vector machines