update model

Browse files

Files changed (10) hide show

README.md +69 -46
all_results.json +125 -0
config.json +1 -1
eval_results.json +60 -0
predict_results.json +62 -0
predictions.txt +0 -0
pytorch_model.bin +1 -1
train_results.json +8 -0
trainer_state.json +553 -0
training_args.bin +2 -2

README.md CHANGED Viewed

@@ -4,48 +4,71 @@ tags:
 - generated_from_trainer
 datasets:
 - cynthiachan/FeedRef_10pct
-metrics:
-- precision
-- recall
-- f1
-- accuracy
 model-index:
-- name: training_3
-  results:
-  - task:
-      name: Token Classification
-      type: token-classification
-    dataset:
-      name: cynthiachan/FeedRef_10pct
-      type: cynthiachan/FeedRef_10pct
-      args: FeedRef_10pct
-    metrics:
-    - name: Precision
-      type: precision
-      value: 0.6786570743405276
-    - name: Recall
-      type: recall
-      value: 0.8372781065088757
-    - name: F1
-      type: f1
-      value: 0.7496688741721853
-    - name: Accuracy
-      type: accuracy
-      value: 0.9678051829961355
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
-# training_3
 This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the cynthiachan/FeedRef_10pct dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1302
-- Precision: 0.6787
-- Recall: 0.8373
-- F1: 0.7497
-- Accuracy: 0.9678
 ## Model description
@@ -74,21 +97,21 @@ The following hyperparameters were used during training:
 ### Training results
-| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| 0.3927        | 0.37  | 500  | 0.2362          | 0.2854    | 0.4112 | 0.3370 | 0.9431   |
-| 0.1994        | 0.75  | 1000 | 0.1656          | 0.4762    | 0.6509 | 0.55   | 0.9550   |
-| 0.1541        | 1.12  | 1500 | 0.1437          | 0.5608    | 0.7367 | 0.6368 | 0.9602   |
-| 0.1275        | 1.5   | 2000 | 0.1497          | 0.6090    | 0.7604 | 0.6763 | 0.9638   |
-| 0.1184        | 1.87  | 2500 | 0.1302          | 0.6787    | 0.8373 | 0.7497 | 0.9678   |
-| 0.0753        | 2.25  | 3000 | 0.1375          | 0.7454    | 0.8314 | 0.7860 | 0.9698   |
-| 0.0613        | 2.62  | 3500 | 0.1465          | 0.8254    | 0.8669 | 0.8456 | 0.9736   |
-| 0.0577        | 3.0   | 4000 | 0.1334          | 0.8144    | 0.8698 | 0.8412 | 0.9746   |
 ### Framework versions
-- Transformers 4.20.0
-- Pytorch 1.11.0+cu102
-- Datasets 2.3.2
 - Tokenizers 0.12.1

 - generated_from_trainer
 datasets:
 - cynthiachan/FeedRef_10pct
 model-index:
+- name: training
+  results: []
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
+# training
 This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the cynthiachan/FeedRef_10pct dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.1291
+- Attackid Precision: 1.0
+- Attackid Recall: 1.0
+- Attackid F1: 1.0
+- Attackid Number: 6
+- Cve Precision: 0.8333
+- Cve Recall: 0.9091
+- Cve F1: 0.8696
+- Cve Number: 11
+- Defenderthreat Precision: 0.0
+- Defenderthreat Recall: 0.0
+- Defenderthreat F1: 0.0
+- Defenderthreat Number: 2
+- Domain Precision: 0.7826
+- Domain Recall: 0.7826
+- Domain F1: 0.7826
+- Domain Number: 23
+- Email Precision: 0.6667
+- Email Recall: 0.6667
+- Email F1: 0.6667
+- Email Number: 3
+- Filepath Precision: 0.6766
+- Filepath Recall: 0.8242
+- Filepath F1: 0.7432
+- Filepath Number: 165
+- Hostname Precision: 1.0
+- Hostname Recall: 0.9167
+- Hostname F1: 0.9565
+- Hostname Number: 12
+- Ipv4 Precision: 0.8333
+- Ipv4 Recall: 0.8333
+- Ipv4 F1: 0.8333
+- Ipv4 Number: 12
+- Md5 Precision: 0.7246
+- Md5 Recall: 0.9615
+- Md5 F1: 0.8264
+- Md5 Number: 52
+- Sha1 Precision: 0.0667
+- Sha1 Recall: 0.1429
+- Sha1 F1: 0.0909
+- Sha1 Number: 7
+- Sha256 Precision: 0.6780
+- Sha256 Recall: 0.9091
+- Sha256 F1: 0.7767
+- Sha256 Number: 44
+- Uri Precision: 0.0
+- Uri Recall: 0.0
+- Uri F1: 0.0
+- Uri Number: 1
+- Overall Precision: 0.6910
+- Overall Recall: 0.8402
+- Overall F1: 0.7583
+- Overall Accuracy: 0.9725
 ## Model description
 ### Training results
+| Training Loss | Epoch | Step | Validation Loss | Attackid Precision | Attackid Recall | Attackid F1 | Attackid Number | Cve Precision | Cve Recall | Cve F1 | Cve Number | Defenderthreat Precision | Defenderthreat Recall | Defenderthreat F1 | Defenderthreat Number | Domain Precision | Domain Recall | Domain F1 | Domain Number | Email Precision | Email Recall | Email F1 | Email Number | Filepath Precision | Filepath Recall | Filepath F1 | Filepath Number | Hostname Precision | Hostname Recall | Hostname F1 | Hostname Number | Ipv4 Precision | Ipv4 Recall | Ipv4 F1 | Ipv4 Number | Md5 Precision | Md5 Recall | Md5 F1 | Md5 Number | Sha1 Precision | Sha1 Recall | Sha1 F1 | Sha1 Number | Sha256 Precision | Sha256 Recall | Sha256 F1 | Sha256 Number | Uri Precision | Uri Recall | Uri F1 | Uri Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------:|:----------:|:------:|:----------:|:------------------------:|:---------------------:|:-----------------:|:---------------------:|:----------------:|:-------------:|:---------:|:-------------:|:---------------:|:------------:|:--------:|:------------:|:------------------:|:---------------:|:-----------:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-------------:|:----------:|:------:|:----------:|:--------------:|:-----------:|:-------:|:-----------:|:----------------:|:-------------:|:---------:|:-------------:|:-------------:|:----------:|:------:|:----------:|:-----------------:|:--------------:|:----------:|:----------------:|
+| 0.3943        | 0.37  | 500  | 0.2881          | 0.0                | 0.0             | 0.0         | 6               | 0.0           | 0.0        | 0.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.0              | 0.0           | 0.0       | 23            | 0.0             | 0.0          | 0.0      | 3            | 0.1138             | 0.2             | 0.1451      | 165             | 0.0692             | 0.9167          | 0.1287      | 12              | 0.4706         | 0.6667      | 0.5517  | 12          | 0.75          | 0.9231     | 0.8276 | 52         | 0.0            | 0.0         | 0.0     | 7           | 0.5694           | 0.9318        | 0.7069    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.2342            | 0.4172         | 0.3        | 0.9360           |
+| 0.1987        | 0.75  | 1000 | 0.1722          | 0.5                | 1.0             | 0.6667      | 6               | 1.0           | 1.0        | 1.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.0              | 0.0           | 0.0       | 23            | 0.0             | 0.0          | 0.0      | 3            | 0.4779             | 0.6545          | 0.5524      | 165             | 0.25               | 0.6667          | 0.3636      | 12              | 0.6923         | 0.75        | 0.7200  | 12          | 0.6364        | 0.9423     | 0.7597 | 52         | 0.0            | 0.0         | 0.0     | 7           | 0.6545           | 0.8182        | 0.7273    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.5136            | 0.6716         | 0.5821     | 0.9529           |
+| 0.1595        | 1.12  | 1500 | 0.1346          | 0.8571             | 1.0             | 0.9231      | 6               | 1.0           | 1.0        | 1.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.4286           | 0.5217        | 0.4706    | 23            | 0.0             | 0.0          | 0.0      | 3            | 0.5797             | 0.7273          | 0.6452      | 165             | 0.44               | 0.9167          | 0.5946      | 12              | 0.3929         | 0.9167      | 0.55    | 12          | 0.6364        | 0.9423     | 0.7597 | 52         | 0.0            | 0.0         | 0.0     | 7           | 0.78             | 0.8864        | 0.8298    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.5768            | 0.7663         | 0.6582     | 0.9658           |
+| 0.118         | 1.5   | 2000 | 0.1436          | 1.0                | 1.0             | 1.0         | 6               | 1.0           | 1.0        | 1.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.6087           | 0.6087        | 0.6087    | 23            | 0.0             | 0.0          | 0.0      | 3            | 0.6101             | 0.8061          | 0.6945      | 165             | 0.9091             | 0.8333          | 0.8696      | 12              | 0.7273         | 0.6667      | 0.6957  | 12          | 0.7869        | 0.9231     | 0.8496 | 52         | 0.2143         | 0.4286      | 0.2857  | 7           | 0.7407           | 0.9091        | 0.8163    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.6675            | 0.8077         | 0.7309     | 0.9686           |
+| 0.1198        | 1.87  | 2500 | 0.1385          | 1.0                | 1.0             | 1.0         | 6               | 0.7692        | 0.9091     | 0.8333 | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.85             | 0.7391        | 0.7907    | 23            | 0.0             | 0.0          | 0.0      | 3            | 0.6390             | 0.7939          | 0.7081      | 165             | 1.0                | 0.8333          | 0.9091      | 12              | 0.5333         | 0.6667      | 0.5926  | 12          | 0.7778        | 0.9423     | 0.8522 | 52         | 0.3333         | 0.5714      | 0.4211  | 7           | 0.8571           | 0.9545        | 0.9032    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.6995            | 0.8195         | 0.7548     | 0.9687           |
+| 0.0742        | 2.25  | 3000 | 0.1291          | 1.0                | 1.0             | 1.0         | 6               | 0.8333        | 0.9091     | 0.8696 | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.7826           | 0.7826        | 0.7826    | 23            | 0.6667          | 0.6667       | 0.6667   | 3            | 0.6766             | 0.8242          | 0.7432      | 165             | 1.0                | 0.9167          | 0.9565      | 12              | 0.8333         | 0.8333      | 0.8333  | 12          | 0.7246        | 0.9615     | 0.8264 | 52         | 0.0667         | 0.1429      | 0.0909  | 7           | 0.6780           | 0.9091        | 0.7767    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.6910            | 0.8402         | 0.7583     | 0.9725           |
+| 0.0687        | 2.62  | 3500 | 0.1385          | 1.0                | 1.0             | 1.0         | 6               | 1.0           | 1.0        | 1.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.8077           | 0.9130        | 0.8571    | 23            | 1.0             | 1.0          | 1.0      | 3            | 0.7746             | 0.8121          | 0.7929      | 165             | 0.7333             | 0.9167          | 0.8148      | 12              | 0.7143         | 0.8333      | 0.7692  | 12          | 0.96          | 0.9231     | 0.9412 | 52         | 0.4444         | 0.5714      | 0.5     | 7           | 0.8113           | 0.9773        | 0.8866    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.8083            | 0.8609         | 0.8338     | 0.9737           |
+| 0.0652        | 3.0   | 4000 | 0.1299          | 1.0                | 1.0             | 1.0         | 6               | 1.0           | 1.0        | 1.0    | 11         | 0.0                      | 0.0                   | 0.0               | 2                     | 0.8077           | 0.9130        | 0.8571    | 23            | 1.0             | 1.0          | 1.0      | 3            | 0.7553             | 0.8606          | 0.8045      | 165             | 0.8462             | 0.9167          | 0.8800      | 12              | 0.7143         | 0.8333      | 0.7692  | 12          | 0.8571        | 0.9231     | 0.8889 | 52         | 0.75           | 0.8571      | 0.8000  | 7           | 0.8723           | 0.9318        | 0.9011    | 44            | 0.0           | 0.0        | 0.0    | 1          | 0.8038            | 0.8846         | 0.8423     | 0.9772           |
 ### Framework versions
+- Transformers 4.21.2
+- Pytorch 1.12.1+cu102
+- Datasets 2.4.0
 - Tokenizers 0.12.1

all_results.json ADDED Viewed

	@@ -0,0 +1,125 @@

+{
+    "epoch": 3.0,
+    "eval_attackID_f1": 1.0,
+    "eval_attackID_number": 6,
+    "eval_attackID_precision": 1.0,
+    "eval_attackID_recall": 1.0,
+    "eval_cve_f1": 0.8695652173913043,
+    "eval_cve_number": 11,
+    "eval_cve_precision": 0.8333333333333334,
+    "eval_cve_recall": 0.9090909090909091,
+    "eval_defenderThreat_f1": 0.0,
+    "eval_defenderThreat_number": 2,
+    "eval_defenderThreat_precision": 0.0,
+    "eval_defenderThreat_recall": 0.0,
+    "eval_domain_f1": 0.782608695652174,
+    "eval_domain_number": 23,
+    "eval_domain_precision": 0.782608695652174,
+    "eval_domain_recall": 0.782608695652174,
+    "eval_email_f1": 0.6666666666666666,
+    "eval_email_number": 3,
+    "eval_email_precision": 0.6666666666666666,
+    "eval_email_recall": 0.6666666666666666,
+    "eval_filepath_f1": 0.7431693989071038,
+    "eval_filepath_number": 165,
+    "eval_filepath_precision": 0.6766169154228856,
+    "eval_filepath_recall": 0.8242424242424242,
+    "eval_hostname_f1": 0.9565217391304348,
+    "eval_hostname_number": 12,
+    "eval_hostname_precision": 1.0,
+    "eval_hostname_recall": 0.9166666666666666,
+    "eval_ipv4_f1": 0.8333333333333334,
+    "eval_ipv4_number": 12,
+    "eval_ipv4_precision": 0.8333333333333334,
+    "eval_ipv4_recall": 0.8333333333333334,
+    "eval_loss": 0.12905733287334442,
+    "eval_md5_f1": 0.8264462809917356,
+    "eval_md5_number": 52,
+    "eval_md5_precision": 0.7246376811594203,
+    "eval_md5_recall": 0.9615384615384616,
+    "eval_overall_accuracy": 0.9725221641282109,
+    "eval_overall_f1": 0.7583444592790387,
+    "eval_overall_precision": 0.6909975669099757,
+    "eval_overall_recall": 0.8402366863905325,
+    "eval_runtime": 134.4538,
+    "eval_samples": 1334,
+    "eval_samples_per_second": 9.922,
+    "eval_sha1_f1": 0.09090909090909091,
+    "eval_sha1_number": 7,
+    "eval_sha1_precision": 0.06666666666666667,
+    "eval_sha1_recall": 0.14285714285714285,
+    "eval_sha256_f1": 0.7766990291262135,
+    "eval_sha256_number": 44,
+    "eval_sha256_precision": 0.6779661016949152,
+    "eval_sha256_recall": 0.9090909090909091,
+    "eval_steps_per_second": 1.242,
+    "eval_uri_f1": 0.0,
+    "eval_uri_number": 1,
+    "eval_uri_precision": 0.0,
+    "eval_uri_recall": 0.0,
+    "predict_attackID_f1": 0.56,
+    "predict_attackID_number": 7,
+    "predict_attackID_precision": 0.3888888888888889,
+    "predict_attackID_recall": 1.0,
+    "predict_bitcoinAddr_f1": 0.0,
+    "predict_bitcoinAddr_number": 1,
+    "predict_bitcoinAddr_precision": 0.0,
+    "predict_bitcoinAddr_recall": 0.0,
+    "predict_cve_f1": 1.0,
+    "predict_cve_number": 4,
+    "predict_cve_precision": 1.0,
+    "predict_cve_recall": 1.0,
+    "predict_domain_f1": 0.8108108108108109,
+    "predict_domain_number": 16,
+    "predict_domain_precision": 0.7142857142857143,
+    "predict_domain_recall": 0.9375,
+    "predict_email_f1": 0.9333333333333333,
+    "predict_email_number": 7,
+    "predict_email_precision": 0.875,
+    "predict_email_recall": 1.0,
+    "predict_filepath_f1": 0.6628571428571429,
+    "predict_filepath_number": 149,
+    "predict_filepath_precision": 0.5771144278606966,
+    "predict_filepath_recall": 0.7785234899328859,
+    "predict_hostname_f1": 0.7500000000000001,
+    "predict_hostname_number": 11,
+    "predict_hostname_precision": 0.6923076923076923,
+    "predict_hostname_recall": 0.8181818181818182,
+    "predict_ipv4_f1": 0.9090909090909091,
+    "predict_ipv4_number": 16,
+    "predict_ipv4_precision": 0.8823529411764706,
+    "predict_ipv4_recall": 0.9375,
+    "predict_ipv6_f1": 0.0,
+    "predict_ipv6_number": 1,
+    "predict_ipv6_precision": 0.0,
+    "predict_ipv6_recall": 0.0,
+    "predict_loss": 0.12927669286727905,
+    "predict_md5_f1": 0.8541666666666667,
+    "predict_md5_number": 43,
+    "predict_md5_precision": 0.7735849056603774,
+    "predict_md5_recall": 0.9534883720930233,
+    "predict_overall_accuracy": 0.9694030870099714,
+    "predict_overall_f1": 0.7312138728323699,
+    "predict_overall_precision": 0.6537467700258398,
+    "predict_overall_recall": 0.8295081967213115,
+    "predict_runtime": 152.1358,
+    "predict_samples_per_second": 8.768,
+    "predict_sha1_f1": 0.0,
+    "predict_sha1_number": 4,
+    "predict_sha1_precision": 0.0,
+    "predict_sha1_recall": 0.0,
+    "predict_sha256_f1": 0.8666666666666666,
+    "predict_sha256_number": 43,
+    "predict_sha256_precision": 0.8297872340425532,
+    "predict_sha256_recall": 0.9069767441860465,
+    "predict_steps_per_second": 1.098,
+    "predict_uri_f1": 0.0,
+    "predict_uri_number": 3,
+    "predict_uri_precision": 0.0,
+    "predict_uri_recall": 0.0,
+    "train_loss": 0.14999645981176205,
+    "train_runtime": 15237.6945,
+    "train_samples": 10671,
+    "train_samples_per_second": 2.101,
+    "train_steps_per_second": 0.263
+}

config.json CHANGED Viewed

@@ -94,7 +94,7 @@
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.20.0",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 28996

   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
+  "transformers_version": "4.21.2",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 28996

eval_results.json ADDED Viewed

	@@ -0,0 +1,60 @@

+{
+    "epoch": 3.0,
+    "eval_attackID_f1": 1.0,
+    "eval_attackID_number": 6,
+    "eval_attackID_precision": 1.0,
+    "eval_attackID_recall": 1.0,
+    "eval_cve_f1": 0.8695652173913043,
+    "eval_cve_number": 11,
+    "eval_cve_precision": 0.8333333333333334,
+    "eval_cve_recall": 0.9090909090909091,
+    "eval_defenderThreat_f1": 0.0,
+    "eval_defenderThreat_number": 2,
+    "eval_defenderThreat_precision": 0.0,
+    "eval_defenderThreat_recall": 0.0,
+    "eval_domain_f1": 0.782608695652174,
+    "eval_domain_number": 23,
+    "eval_domain_precision": 0.782608695652174,
+    "eval_domain_recall": 0.782608695652174,
+    "eval_email_f1": 0.6666666666666666,
+    "eval_email_number": 3,
+    "eval_email_precision": 0.6666666666666666,
+    "eval_email_recall": 0.6666666666666666,
+    "eval_filepath_f1": 0.7431693989071038,
+    "eval_filepath_number": 165,
+    "eval_filepath_precision": 0.6766169154228856,
+    "eval_filepath_recall": 0.8242424242424242,
+    "eval_hostname_f1": 0.9565217391304348,
+    "eval_hostname_number": 12,
+    "eval_hostname_precision": 1.0,
+    "eval_hostname_recall": 0.9166666666666666,
+    "eval_ipv4_f1": 0.8333333333333334,
+    "eval_ipv4_number": 12,
+    "eval_ipv4_precision": 0.8333333333333334,
+    "eval_ipv4_recall": 0.8333333333333334,
+    "eval_loss": 0.12905733287334442,
+    "eval_md5_f1": 0.8264462809917356,
+    "eval_md5_number": 52,
+    "eval_md5_precision": 0.7246376811594203,
+    "eval_md5_recall": 0.9615384615384616,
+    "eval_overall_accuracy": 0.9725221641282109,
+    "eval_overall_f1": 0.7583444592790387,
+    "eval_overall_precision": 0.6909975669099757,
+    "eval_overall_recall": 0.8402366863905325,
+    "eval_runtime": 134.4538,
+    "eval_samples": 1334,
+    "eval_samples_per_second": 9.922,
+    "eval_sha1_f1": 0.09090909090909091,
+    "eval_sha1_number": 7,
+    "eval_sha1_precision": 0.06666666666666667,
+    "eval_sha1_recall": 0.14285714285714285,
+    "eval_sha256_f1": 0.7766990291262135,
+    "eval_sha256_number": 44,
+    "eval_sha256_precision": 0.6779661016949152,
+    "eval_sha256_recall": 0.9090909090909091,
+    "eval_steps_per_second": 1.242,
+    "eval_uri_f1": 0.0,
+    "eval_uri_number": 1,
+    "eval_uri_precision": 0.0,
+    "eval_uri_recall": 0.0
+}

predict_results.json ADDED Viewed

	@@ -0,0 +1,62 @@

+{
+    "predict_attackID_f1": 0.56,
+    "predict_attackID_number": 7,
+    "predict_attackID_precision": 0.3888888888888889,
+    "predict_attackID_recall": 1.0,
+    "predict_bitcoinAddr_f1": 0.0,
+    "predict_bitcoinAddr_number": 1,
+    "predict_bitcoinAddr_precision": 0.0,
+    "predict_bitcoinAddr_recall": 0.0,
+    "predict_cve_f1": 1.0,
+    "predict_cve_number": 4,
+    "predict_cve_precision": 1.0,
+    "predict_cve_recall": 1.0,
+    "predict_domain_f1": 0.8108108108108109,
+    "predict_domain_number": 16,
+    "predict_domain_precision": 0.7142857142857143,
+    "predict_domain_recall": 0.9375,
+    "predict_email_f1": 0.9333333333333333,
+    "predict_email_number": 7,
+    "predict_email_precision": 0.875,
+    "predict_email_recall": 1.0,
+    "predict_filepath_f1": 0.6628571428571429,
+    "predict_filepath_number": 149,
+    "predict_filepath_precision": 0.5771144278606966,
+    "predict_filepath_recall": 0.7785234899328859,
+    "predict_hostname_f1": 0.7500000000000001,
+    "predict_hostname_number": 11,
+    "predict_hostname_precision": 0.6923076923076923,
+    "predict_hostname_recall": 0.8181818181818182,
+    "predict_ipv4_f1": 0.9090909090909091,
+    "predict_ipv4_number": 16,
+    "predict_ipv4_precision": 0.8823529411764706,
+    "predict_ipv4_recall": 0.9375,
+    "predict_ipv6_f1": 0.0,
+    "predict_ipv6_number": 1,
+    "predict_ipv6_precision": 0.0,
+    "predict_ipv6_recall": 0.0,
+    "predict_loss": 0.12927669286727905,
+    "predict_md5_f1": 0.8541666666666667,
+    "predict_md5_number": 43,
+    "predict_md5_precision": 0.7735849056603774,
+    "predict_md5_recall": 0.9534883720930233,
+    "predict_overall_accuracy": 0.9694030870099714,
+    "predict_overall_f1": 0.7312138728323699,
+    "predict_overall_precision": 0.6537467700258398,
+    "predict_overall_recall": 0.8295081967213115,
+    "predict_runtime": 152.1358,
+    "predict_samples_per_second": 8.768,
+    "predict_sha1_f1": 0.0,
+    "predict_sha1_number": 4,
+    "predict_sha1_precision": 0.0,
+    "predict_sha1_recall": 0.0,
+    "predict_sha256_f1": 0.8666666666666666,
+    "predict_sha256_number": 43,
+    "predict_sha256_precision": 0.8297872340425532,
+    "predict_sha256_recall": 0.9069767441860465,
+    "predict_steps_per_second": 1.098,
+    "predict_uri_f1": 0.0,
+    "predict_uri_number": 3,
+    "predict_uri_precision": 0.0,
+    "predict_uri_recall": 0.0
+}

predictions.txt ADDED Viewed

The diff for this file is too large to render. See raw diff

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3de499157bfdea2ea7b3d46af18b32df3bad9bf8a4d0f35f2adab2ed92203b8d
 size 431054001

 version https://git-lfs.github.com/spec/v1
+oid sha256:66281b5a91bfcd09dc9205cc3154596a73678ace8c29e59cb8fc06d932b1d67e
 size 431054001

train_results.json ADDED Viewed

	@@ -0,0 +1,8 @@

+{
+    "epoch": 3.0,
+    "train_loss": 0.14999645981176205,
+    "train_runtime": 15237.6945,
+    "train_samples": 10671,
+    "train_samples_per_second": 2.101,
+    "train_steps_per_second": 0.263
+}

trainer_state.json ADDED Viewed

	@@ -0,0 +1,553 @@

+{
+  "best_metric": 0.12905733287334442,
+  "best_model_checkpoint": "training/checkpoint-3000",
+  "epoch": 3.0,
+  "global_step": 4002,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.37,
+      "learning_rate": 4.3753123438280864e-05,
+      "loss": 0.3943,
+      "step": 500
+    },
+    {
+      "epoch": 0.37,
+      "eval_attackID_f1": 0.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 0.0,
+      "eval_attackID_recall": 0.0,
+      "eval_cve_f1": 0.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 0.0,
+      "eval_cve_recall": 0.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.0,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.0,
+      "eval_domain_recall": 0.0,
+      "eval_email_f1": 0.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.0,
+      "eval_email_recall": 0.0,
+      "eval_filepath_f1": 0.14505494505494507,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.11379310344827587,
+      "eval_filepath_recall": 0.2,
+      "eval_hostname_f1": 0.1286549707602339,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.06918238993710692,
+      "eval_hostname_recall": 0.9166666666666666,
+      "eval_ipv4_f1": 0.5517241379310345,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.47058823529411764,
+      "eval_ipv4_recall": 0.6666666666666666,
+      "eval_loss": 0.28811344504356384,
+      "eval_md5_f1": 0.8275862068965517,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.75,
+      "eval_md5_recall": 0.9230769230769231,
+      "eval_overall_accuracy": 0.9359797681291202,
+      "eval_overall_f1": 0.3,
+      "eval_overall_precision": 0.23421926910299004,
+      "eval_overall_recall": 0.4171597633136095,
+      "eval_runtime": 134.2603,
+      "eval_samples_per_second": 9.936,
+      "eval_sha1_f1": 0.0,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.0,
+      "eval_sha1_recall": 0.0,
+      "eval_sha256_f1": 0.7068965517241379,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.5694444444444444,
+      "eval_sha256_recall": 0.9318181818181818,
+      "eval_steps_per_second": 1.244,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 500
+    },
+    {
+      "epoch": 0.75,
+      "learning_rate": 3.7506246876561725e-05,
+      "loss": 0.1987,
+      "step": 1000
+    },
+    {
+      "epoch": 0.75,
+      "eval_attackID_f1": 0.6666666666666666,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 0.5,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 1.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 1.0,
+      "eval_cve_recall": 1.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.0,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.0,
+      "eval_domain_recall": 0.0,
+      "eval_email_f1": 0.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.0,
+      "eval_email_recall": 0.0,
+      "eval_filepath_f1": 0.5524296675191817,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.4778761061946903,
+      "eval_filepath_recall": 0.6545454545454545,
+      "eval_hostname_f1": 0.36363636363636365,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.25,
+      "eval_hostname_recall": 0.6666666666666666,
+      "eval_ipv4_f1": 0.7199999999999999,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.6923076923076923,
+      "eval_ipv4_recall": 0.75,
+      "eval_loss": 0.1722334325313568,
+      "eval_md5_f1": 0.7596899224806201,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.6363636363636364,
+      "eval_md5_recall": 0.9423076923076923,
+      "eval_overall_accuracy": 0.952943850875199,
+      "eval_overall_f1": 0.582051282051282,
+      "eval_overall_precision": 0.5135746606334841,
+      "eval_overall_recall": 0.6715976331360947,
+      "eval_runtime": 134.6173,
+      "eval_samples_per_second": 9.91,
+      "eval_sha1_f1": 0.0,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.0,
+      "eval_sha1_recall": 0.0,
+      "eval_sha256_f1": 0.7272727272727274,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.6545454545454545,
+      "eval_sha256_recall": 0.8181818181818182,
+      "eval_steps_per_second": 1.241,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 1000
+    },
+    {
+      "epoch": 1.12,
+      "learning_rate": 3.125937031484258e-05,
+      "loss": 0.1595,
+      "step": 1500
+    },
+    {
+      "epoch": 1.12,
+      "eval_attackID_f1": 0.923076923076923,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 0.8571428571428571,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 1.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 1.0,
+      "eval_cve_recall": 1.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.47058823529411764,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.42857142857142855,
+      "eval_domain_recall": 0.5217391304347826,
+      "eval_email_f1": 0.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.0,
+      "eval_email_recall": 0.0,
+      "eval_filepath_f1": 0.6451612903225806,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.5797101449275363,
+      "eval_filepath_recall": 0.7272727272727273,
+      "eval_hostname_f1": 0.5945945945945945,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.44,
+      "eval_hostname_recall": 0.9166666666666666,
+      "eval_ipv4_f1": 0.55,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.39285714285714285,
+      "eval_ipv4_recall": 0.9166666666666666,
+      "eval_loss": 0.13464373350143433,
+      "eval_md5_f1": 0.7596899224806201,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.6363636363636364,
+      "eval_md5_recall": 0.9423076923076923,
+      "eval_overall_accuracy": 0.9658160945669471,
+      "eval_overall_f1": 0.6581956797966962,
+      "eval_overall_precision": 0.576837416481069,
+      "eval_overall_recall": 0.7662721893491125,
+      "eval_runtime": 134.9668,
+      "eval_samples_per_second": 9.884,
+      "eval_sha1_f1": 0.0,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.0,
+      "eval_sha1_recall": 0.0,
+      "eval_sha256_f1": 0.8297872340425532,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.78,
+      "eval_sha256_recall": 0.8863636363636364,
+      "eval_steps_per_second": 1.237,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 1500
+    },
+    {
+      "epoch": 1.5,
+      "learning_rate": 2.501249375312344e-05,
+      "loss": 0.118,
+      "step": 2000
+    },
+    {
+      "epoch": 1.5,
+      "eval_attackID_f1": 1.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 1.0,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 1.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 1.0,
+      "eval_cve_recall": 1.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.6086956521739131,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.6086956521739131,
+      "eval_domain_recall": 0.6086956521739131,
+      "eval_email_f1": 0.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.0,
+      "eval_email_recall": 0.0,
+      "eval_filepath_f1": 0.6945169712793734,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.6100917431192661,
+      "eval_filepath_recall": 0.806060606060606,
+      "eval_hostname_f1": 0.8695652173913043,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.9090909090909091,
+      "eval_hostname_recall": 0.8333333333333334,
+      "eval_ipv4_f1": 0.6956521739130435,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.7272727272727273,
+      "eval_ipv4_recall": 0.6666666666666666,
+      "eval_loss": 0.143614262342453,
+      "eval_md5_f1": 0.8495575221238939,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.7868852459016393,
+      "eval_md5_recall": 0.9230769230769231,
+      "eval_overall_accuracy": 0.9685724028188225,
+      "eval_overall_f1": 0.7309236947791166,
+      "eval_overall_precision": 0.6674816625916871,
+      "eval_overall_recall": 0.8076923076923077,
+      "eval_runtime": 134.9205,
+      "eval_samples_per_second": 9.887,
+      "eval_sha1_f1": 0.2857142857142857,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.21428571428571427,
+      "eval_sha1_recall": 0.42857142857142855,
+      "eval_sha256_f1": 0.8163265306122449,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.7407407407407407,
+      "eval_sha256_recall": 0.9090909090909091,
+      "eval_steps_per_second": 1.238,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 2000
+    },
+    {
+      "epoch": 1.87,
+      "learning_rate": 1.87656171914043e-05,
+      "loss": 0.1198,
+      "step": 2500
+    },
+    {
+      "epoch": 1.87,
+      "eval_attackID_f1": 1.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 1.0,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 0.8333333333333333,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 0.7692307692307693,
+      "eval_cve_recall": 0.9090909090909091,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.7906976744186046,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.85,
+      "eval_domain_recall": 0.7391304347826086,
+      "eval_email_f1": 0.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.0,
+      "eval_email_recall": 0.0,
+      "eval_filepath_f1": 0.708108108108108,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.6390243902439025,
+      "eval_filepath_recall": 0.793939393939394,
+      "eval_hostname_f1": 0.9090909090909091,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 1.0,
+      "eval_hostname_recall": 0.8333333333333334,
+      "eval_ipv4_f1": 0.5925925925925926,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.5333333333333333,
+      "eval_ipv4_recall": 0.6666666666666666,
+      "eval_loss": 0.13847950100898743,
+      "eval_md5_f1": 0.8521739130434781,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.7777777777777778,
+      "eval_md5_recall": 0.9423076923076923,
+      "eval_overall_accuracy": 0.9687144805637645,
+      "eval_overall_f1": 0.7547683923705721,
+      "eval_overall_precision": 0.6994949494949495,
+      "eval_overall_recall": 0.8195266272189349,
+      "eval_runtime": 135.1754,
+      "eval_samples_per_second": 9.869,
+      "eval_sha1_f1": 0.4210526315789474,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.3333333333333333,
+      "eval_sha1_recall": 0.5714285714285714,
+      "eval_sha256_f1": 0.9032258064516128,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.8571428571428571,
+      "eval_sha256_recall": 0.9545454545454546,
+      "eval_steps_per_second": 1.235,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 2500
+    },
+    {
+      "epoch": 2.25,
+      "learning_rate": 1.2518740629685157e-05,
+      "loss": 0.0742,
+      "step": 3000
+    },
+    {
+      "epoch": 2.25,
+      "eval_attackID_f1": 1.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 1.0,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 0.8695652173913043,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 0.8333333333333334,
+      "eval_cve_recall": 0.9090909090909091,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.782608695652174,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.782608695652174,
+      "eval_domain_recall": 0.782608695652174,
+      "eval_email_f1": 0.6666666666666666,
+      "eval_email_number": 3,
+      "eval_email_precision": 0.6666666666666666,
+      "eval_email_recall": 0.6666666666666666,
+      "eval_filepath_f1": 0.7431693989071038,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.6766169154228856,
+      "eval_filepath_recall": 0.8242424242424242,
+      "eval_hostname_f1": 0.9565217391304348,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 1.0,
+      "eval_hostname_recall": 0.9166666666666666,
+      "eval_ipv4_f1": 0.8333333333333334,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.8333333333333334,
+      "eval_ipv4_recall": 0.8333333333333334,
+      "eval_loss": 0.12905733287334442,
+      "eval_md5_f1": 0.8264462809917356,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.7246376811594203,
+      "eval_md5_recall": 0.9615384615384616,
+      "eval_overall_accuracy": 0.9725221641282109,
+      "eval_overall_f1": 0.7583444592790387,
+      "eval_overall_precision": 0.6909975669099757,
+      "eval_overall_recall": 0.8402366863905325,
+      "eval_runtime": 133.4856,
+      "eval_samples_per_second": 9.994,
+      "eval_sha1_f1": 0.09090909090909091,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.06666666666666667,
+      "eval_sha1_recall": 0.14285714285714285,
+      "eval_sha256_f1": 0.7766990291262135,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.6779661016949152,
+      "eval_sha256_recall": 0.9090909090909091,
+      "eval_steps_per_second": 1.251,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 3000
+    },
+    {
+      "epoch": 2.62,
+      "learning_rate": 6.271864067966017e-06,
+      "loss": 0.0687,
+      "step": 3500
+    },
+    {
+      "epoch": 2.62,
+      "eval_attackID_f1": 1.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 1.0,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 1.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 1.0,
+      "eval_cve_recall": 1.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.8571428571428572,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.8076923076923077,
+      "eval_domain_recall": 0.9130434782608695,
+      "eval_email_f1": 1.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 1.0,
+      "eval_email_recall": 1.0,
+      "eval_filepath_f1": 0.7928994082840237,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.7745664739884393,
+      "eval_filepath_recall": 0.8121212121212121,
+      "eval_hostname_f1": 0.8148148148148148,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.7333333333333333,
+      "eval_hostname_recall": 0.9166666666666666,
+      "eval_ipv4_f1": 0.7692307692307692,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.7142857142857143,
+      "eval_ipv4_recall": 0.8333333333333334,
+      "eval_loss": 0.13853736221790314,
+      "eval_md5_f1": 0.9411764705882353,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.96,
+      "eval_md5_recall": 0.9230769230769231,
+      "eval_overall_accuracy": 0.9736587860877473,
+      "eval_overall_f1": 0.833810888252149,
+      "eval_overall_precision": 0.8083333333333333,
+      "eval_overall_recall": 0.8609467455621301,
+      "eval_runtime": 134.7978,
+      "eval_samples_per_second": 9.896,
+      "eval_sha1_f1": 0.5,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.4444444444444444,
+      "eval_sha1_recall": 0.5714285714285714,
+      "eval_sha256_f1": 0.88659793814433,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.8113207547169812,
+      "eval_sha256_recall": 0.9772727272727273,
+      "eval_steps_per_second": 1.239,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 3500
+    },
+    {
+      "epoch": 3.0,
+      "learning_rate": 2.4987506246876563e-08,
+      "loss": 0.0652,
+      "step": 4000
+    },
+    {
+      "epoch": 3.0,
+      "eval_attackID_f1": 1.0,
+      "eval_attackID_number": 6,
+      "eval_attackID_precision": 1.0,
+      "eval_attackID_recall": 1.0,
+      "eval_cve_f1": 1.0,
+      "eval_cve_number": 11,
+      "eval_cve_precision": 1.0,
+      "eval_cve_recall": 1.0,
+      "eval_defenderThreat_f1": 0.0,
+      "eval_defenderThreat_number": 2,
+      "eval_defenderThreat_precision": 0.0,
+      "eval_defenderThreat_recall": 0.0,
+      "eval_domain_f1": 0.8571428571428572,
+      "eval_domain_number": 23,
+      "eval_domain_precision": 0.8076923076923077,
+      "eval_domain_recall": 0.9130434782608695,
+      "eval_email_f1": 1.0,
+      "eval_email_number": 3,
+      "eval_email_precision": 1.0,
+      "eval_email_recall": 1.0,
+      "eval_filepath_f1": 0.8045325779036826,
+      "eval_filepath_number": 165,
+      "eval_filepath_precision": 0.7553191489361702,
+      "eval_filepath_recall": 0.8606060606060606,
+      "eval_hostname_f1": 0.8799999999999999,
+      "eval_hostname_number": 12,
+      "eval_hostname_precision": 0.8461538461538461,
+      "eval_hostname_recall": 0.9166666666666666,
+      "eval_ipv4_f1": 0.7692307692307692,
+      "eval_ipv4_number": 12,
+      "eval_ipv4_precision": 0.7142857142857143,
+      "eval_ipv4_recall": 0.8333333333333334,
+      "eval_loss": 0.12987127900123596,
+      "eval_md5_f1": 0.888888888888889,
+      "eval_md5_number": 52,
+      "eval_md5_precision": 0.8571428571428571,
+      "eval_md5_recall": 0.9230769230769231,
+      "eval_overall_accuracy": 0.9772107297112981,
+      "eval_overall_f1": 0.8422535211267606,
+      "eval_overall_precision": 0.803763440860215,
+      "eval_overall_recall": 0.8846153846153846,
+      "eval_runtime": 135.2467,
+      "eval_samples_per_second": 9.863,
+      "eval_sha1_f1": 0.7999999999999999,
+      "eval_sha1_number": 7,
+      "eval_sha1_precision": 0.75,
+      "eval_sha1_recall": 0.8571428571428571,
+      "eval_sha256_f1": 0.9010989010989012,
+      "eval_sha256_number": 44,
+      "eval_sha256_precision": 0.8723404255319149,
+      "eval_sha256_recall": 0.9318181818181818,
+      "eval_steps_per_second": 1.235,
+      "eval_uri_f1": 0.0,
+      "eval_uri_number": 1,
+      "eval_uri_precision": 0.0,
+      "eval_uri_recall": 0.0,
+      "step": 4000
+    },
+    {
+      "epoch": 3.0,
+      "step": 4002,
+      "total_flos": 1598290045571520.0,
+      "train_loss": 0.14999645981176205,
+      "train_runtime": 15237.6945,
+      "train_samples_per_second": 2.101,
+      "train_steps_per_second": 0.263
+    }
+  ],
+  "max_steps": 4002,
+  "num_train_epochs": 3,
+  "total_flos": 1598290045571520.0,
+  "trial_name": null,
+  "trial_params": null
+}

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:424071fcbc8dac0d86ad6e221e9f19de6c334bd1b93afb168b98b0a75cb7a6b6
-size 3247

 version https://git-lfs.github.com/spec/v1
+oid sha256:4a4555401ac41da9be8384996a66e78116ea3968b20efdcf58fba2df26108990
+size 3311