Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,9 @@ This model is made for educational purposes and is not ready to be used in produ
|
|
| 10 |
## Training Procedure
|
| 11 |
|
| 12 |
With this dataset, I will be using a decision tree to predict whether certain websites are legitimate or an act of phishing. This is because Naive Bayes assumes feature independence, which is not true for this case. Decision trees split data based on actual patterns, which is useful for phishing detection.
|
|
|
|
| 13 |
Overall, the data does not meet the criteria for Naive Bayes because the features are not independent.
|
|
|
|
| 14 |
Using decision trees for this case is crucial because it offers clear interpretability of the classification logic. It will be able to differentiate legitimate vs illegitimate websites and also give an answer to why.
|
| 15 |
|
| 16 |
### Hyperparameters
|
|
@@ -119,6 +121,11 @@ div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,
|
|
| 119 |
|
| 120 |
## Evaluation Results
|
| 121 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
precision recall f1-score support
|
| 123 |
|
| 124 |
0 1.00 0.74 0.85 20189
|
|
@@ -128,7 +135,8 @@ div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,
|
|
| 128 |
macro avg 0.92 0.87 0.88 47159
|
| 129 |
weighted avg 0.91 0.89 0.88 47159
|
| 130 |
|
| 131 |
-
The overall accuracy of the model was 89
|
|
|
|
| 132 |
The model could possibly be used for real scenarios, but not for high risk use. It would be helpful in situations where you only need a general screening of phishing vs legitimate websites. So although it is accurate, it is not accurate enough. However, I would still trust this model. It performs well and behaves predictably. If more precision/recall is needed, then it would certainly make sense to use a more complex model. It all depends on what the model is being used for.
|
| 133 |
|
| 134 |
# Model Card Authors
|
|
|
|
| 10 |
## Training Procedure
|
| 11 |
|
| 12 |
With this dataset, I will be using a decision tree to predict whether certain websites are legitimate or an act of phishing. This is because Naive Bayes assumes feature independence, which is not true for this case. Decision trees split data based on actual patterns, which is useful for phishing detection.
|
| 13 |
+
|
| 14 |
Overall, the data does not meet the criteria for Naive Bayes because the features are not independent.
|
| 15 |
+
|
| 16 |
Using decision trees for this case is crucial because it offers clear interpretability of the classification logic. It will be able to differentiate legitimate vs illegitimate websites and also give an answer to why.
|
| 17 |
|
| 18 |
### Hyperparameters
|
|
|
|
| 121 |
|
| 122 |
## Evaluation Results
|
| 123 |
|
| 124 |
+
plt.figure(figsize=(15,20))
|
| 125 |
+
tree.plot_tree(dt, rounded =True, class_names = ['0','1'],
|
| 126 |
+
proportion=True, filled =True, impurity=False,fontsize=10);
|
| 127 |
+
|
| 128 |
+
|
| 129 |
precision recall f1-score support
|
| 130 |
|
| 131 |
0 1.00 0.74 0.85 20189
|
|
|
|
| 135 |
macro avg 0.92 0.87 0.88 47159
|
| 136 |
weighted avg 0.91 0.89 0.88 47159
|
| 137 |
|
| 138 |
+
The overall accuracy of the model was 89%. For Class 0, the precision score was 100%, meaning it was able to predict every phishing website correctly. Its recall score was 74%, meaning it missed about 26% of actual phishing samples. For Class 1, its precision score was 84% and its recall score was 100%. This shows that the model leans toward predicting '1,' while favoring recall rather than precision.
|
| 139 |
+
|
| 140 |
The model could possibly be used for real scenarios, but not for high risk use. It would be helpful in situations where you only need a general screening of phishing vs legitimate websites. So although it is accurate, it is not accurate enough. However, I would still trust this model. It performs well and behaves predictably. If more precision/recall is needed, then it would certainly make sense to use a more complex model. It all depends on what the model is being used for.
|
| 141 |
|
| 142 |
# Model Card Authors
|