For issue #9 determining the cutoff based on the training data and applying that cutoff on the model's final confidence/probability output.  There is not a significant improvement in doing this.