File size: 2,175 Bytes
321c2bb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
Logging training
Running DummyClassifier()
accuracy: 0.616 average_precision: 0.384 roc_auc: 0.500 recall_macro: 0.500 f1_macro: 0.381
=== new best DummyClassifier() (using recall_macro):
accuracy: 0.616 average_precision: 0.384 roc_auc: 0.500 recall_macro: 0.500 f1_macro: 0.381

Running GaussianNB()
accuracy: 0.425 average_precision: 0.749 roc_auc: 0.825 recall_macro: 0.530 f1_macro: 0.355
=== new best GaussianNB() (using recall_macro):
accuracy: 0.425 average_precision: 0.749 roc_auc: 0.825 recall_macro: 0.530 f1_macro: 0.355

Running MultinomialNB()
accuracy: 0.771 average_precision: 0.800 roc_auc: 0.837 recall_macro: 0.748 f1_macro: 0.752
=== new best MultinomialNB() (using recall_macro):
accuracy: 0.771 average_precision: 0.800 roc_auc: 0.837 recall_macro: 0.748 f1_macro: 0.752

Running DecisionTreeClassifier(class_weight='balanced', max_depth=1)
accuracy: 0.787 average_precision: 0.630 roc_auc: 0.767 recall_macro: 0.767 f1_macro: 0.771
=== new best DecisionTreeClassifier(class_weight='balanced', max_depth=1) (using recall_macro):
accuracy: 0.787 average_precision: 0.630 roc_auc: 0.767 recall_macro: 0.767 f1_macro: 0.771

Running DecisionTreeClassifier(class_weight='balanced', max_depth=5)
accuracy: 0.804 average_precision: 0.801 roc_auc: 0.848 recall_macro: 0.796 f1_macro: 0.794
=== new best DecisionTreeClassifier(class_weight='balanced', max_depth=5) (using recall_macro):
accuracy: 0.804 average_precision: 0.801 roc_auc: 0.848 recall_macro: 0.796 f1_macro: 0.794

Running DecisionTreeClassifier(class_weight='balanced', min_impurity_decrease=0.01)
accuracy: 0.786 average_precision: 0.777 roc_auc: 0.840 recall_macro: 0.773 f1_macro: 0.772
Running LogisticRegression(C=0.1, class_weight='balanced', max_iter=1000)
accuracy: 0.783 average_precision: 0.823 roc_auc: 0.850 recall_macro: 0.779 f1_macro: 0.774
Running LogisticRegression(class_weight='balanced', max_iter=1000)
accuracy: 0.788 average_precision: 0.822 roc_auc: 0.851 recall_macro: 0.784 f1_macro: 0.779

Best model:
DecisionTreeClassifier(class_weight='balanced', max_depth=5)
Best Scores:
accuracy: 0.804 average_precision: 0.801 roc_auc: 0.848 recall_macro: 0.796 f1_macro: 0.794