this is well known so i'm unclear on why this was removed see author hanley j a and mcneil b j year title the meaning and use of the area under a receiver operating characteristic roc curve journal radiology volume pages annote diagnosis testing roc c index