djsull/ner_insurence_roberta
Browse files
README.md
CHANGED
@@ -19,11 +19,11 @@ should probably proofread and complete it, then remove this comment. -->
|
|
19 |
|
20 |
This model is a fine-tuned version of [klue/roberta-small](https://huggingface.co/klue/roberta-small) on an unknown dataset.
|
21 |
It achieves the following results on the evaluation set:
|
22 |
-
- Loss: 0.
|
23 |
-
- Precision: 0.
|
24 |
-
- Recall: 0.
|
25 |
-
- F1: 0.
|
26 |
-
- Accuracy: 0.
|
27 |
|
28 |
## Model description
|
29 |
|
@@ -43,25 +43,22 @@ More information needed
|
|
43 |
|
44 |
The following hyperparameters were used during training:
|
45 |
- learning_rate: 5e-05
|
46 |
-
- train_batch_size:
|
47 |
-
- eval_batch_size:
|
48 |
- seed: 42
|
49 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
50 |
- lr_scheduler_type: linear
|
51 |
-
- num_epochs:
|
52 |
|
53 |
### Training results
|
54 |
|
55 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
56 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
57 |
-
|
|
58 |
-
|
|
59 |
-
|
|
60 |
-
| 0.
|
61 |
-
| 0.
|
62 |
-
| 0.0004 | 6.0 | 3030 | 0.0010 | 0.9453 | 0.9483 | 0.9468 | 0.9997 |
|
63 |
-
| 0.0002 | 7.0 | 3535 | 0.0012 | 0.9463 | 0.9473 | 0.9468 | 0.9997 |
|
64 |
-
| 0.0001 | 8.0 | 4040 | 0.0012 | 0.9483 | 0.9473 | 0.9478 | 0.9997 |
|
65 |
|
66 |
|
67 |
### Framework versions
|
|
|
19 |
|
20 |
This model is a fine-tuned version of [klue/roberta-small](https://huggingface.co/klue/roberta-small) on an unknown dataset.
|
21 |
It achieves the following results on the evaluation set:
|
22 |
+
- Loss: 0.0014
|
23 |
+
- Precision: 0.9275
|
24 |
+
- Recall: 0.9314
|
25 |
+
- F1: 0.9295
|
26 |
+
- Accuracy: 0.9996
|
27 |
|
28 |
## Model description
|
29 |
|
|
|
43 |
|
44 |
The following hyperparameters were used during training:
|
45 |
- learning_rate: 5e-05
|
46 |
+
- train_batch_size: 64
|
47 |
+
- eval_batch_size: 64
|
48 |
- seed: 42
|
49 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
50 |
- lr_scheduler_type: linear
|
51 |
+
- num_epochs: 5
|
52 |
|
53 |
### Training results
|
54 |
|
55 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
56 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
57 |
+
| No log | 1.0 | 127 | 0.0032 | 0.8493 | 0.8618 | 0.8555 | 0.9990 |
|
58 |
+
| No log | 2.0 | 254 | 0.0020 | 0.8841 | 0.9008 | 0.8924 | 0.9994 |
|
59 |
+
| No log | 3.0 | 381 | 0.0014 | 0.9152 | 0.9219 | 0.9185 | 0.9996 |
|
60 |
+
| 0.0088 | 4.0 | 508 | 0.0014 | 0.9275 | 0.9314 | 0.9295 | 0.9996 |
|
61 |
+
| 0.0088 | 5.0 | 635 | 0.0013 | 0.9225 | 0.9293 | 0.9259 | 0.9996 |
|
|
|
|
|
|
|
62 |
|
63 |
|
64 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 270022684
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c24d57463d68e114879f96e2336260c16398fe87c943351ec3c699bd34559359
|
3 |
size 270022684
|
runs/May31_06-22-51_129-146-79-76/events.out.tfevents.1717136571.129-146-79-76.3801064.5
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:09e355cbb427d77c626448b37907503e9b58c98b58bc6c6837843d804aab5a1a
|
3 |
+
size 7870
|
runs/May31_06-22-51_129-146-79-76/events.out.tfevents.1717137082.129-146-79-76.3801064.6
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a0d377ab88c71a41e53af73b704ac506535f59c7e9e23b4d8c0e8eff3145b9d7
|
3 |
+
size 560
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4603
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b6c324c0f7d5d969955094a47789d63d9e7e238e507e143b62ddfdb2f70328f5
|
3 |
size 4603
|