jdurbin/wekaMine — Issue #2: Ability to generate a null model for cross-validated ROC's. 
Author: jdurbin
Created: 2011-10-15 05:02:33+00:00
State: open
Labels: Feature Request

In wmSaveModel:

```
do 100 times:
Permute the sample names
run CV
Save roc value in distribution array.
```

in wmClassify:

```
evaluate model
compute p value from saved roc distribution
optionally output entire distribution for reference..
```

This should be written as a durbinlib class or set of methods because it would be nice, if expensive, to allow this output to be part of wekaMine's normal operation too....