GlycerinLOL
commited on
Commit
•
f831bae
1
Parent(s):
543cbc9
Model save
Browse files
README.md
CHANGED
@@ -19,15 +19,15 @@ should probably proofread and complete it, then remove this comment. -->
|
|
19 |
|
20 |
This model is a fine-tuned version of [google/pegasus-xsum](https://huggingface.co/google/pegasus-xsum) on an unknown dataset.
|
21 |
It achieves the following results on the evaluation set:
|
22 |
-
- Loss: 1.
|
23 |
-
- Rouge1: 0.
|
24 |
-
- Rouge2: 0.
|
25 |
-
- Rougel: 0.
|
26 |
-
- Rougelsum: 0.
|
27 |
-
- Gen Len: 26.
|
28 |
-
- Precision: 0.
|
29 |
-
- Recall: 0.
|
30 |
-
- F1: 0.
|
31 |
|
32 |
## Model description
|
33 |
|
@@ -54,7 +54,7 @@ The following hyperparameters were used during training:
|
|
54 |
- total_train_batch_size: 128
|
55 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
56 |
- lr_scheduler_type: linear
|
57 |
-
- num_epochs:
|
58 |
- mixed_precision_training: Native AMP
|
59 |
|
60 |
### Training results
|
@@ -72,11 +72,15 @@ The following hyperparameters were used during training:
|
|
72 |
| 1.7559 | 9.0 | 3511 | 0.9086 | 26.424 | 1.6662 | 0.9098 | 0.9078 | 0.4632 | 0.215 | 0.38 | 0.3799 |
|
73 |
| 1.7559 | 10.0 | 3902 | 0.9089 | 26.5425 | 1.6594 | 0.9099 | 0.9082 | 0.4651 | 0.2168 | 0.3812 | 0.3812 |
|
74 |
| 1.7357 | 11.0 | 4293 | 0.9091 | 26.6051 | 1.6555 | 0.91 | 0.9086 | 0.4663 | 0.2178 | 0.3824 | 0.3823 |
|
75 |
-
| 1.7297 | 12.0 | 4680 |
|
76 |
-
| 1.7165 | 13.0 | 5071 |
|
77 |
-
| 1.7165 | 14.0 | 5462 |
|
78 |
-
| 1.7068 | 15.0 | 5853 |
|
79 |
-
| 1.7004 |
|
|
|
|
|
|
|
|
|
80 |
|
81 |
|
82 |
### Framework versions
|
|
|
19 |
|
20 |
This model is a fine-tuned version of [google/pegasus-xsum](https://huggingface.co/google/pegasus-xsum) on an unknown dataset.
|
21 |
It achieves the following results on the evaluation set:
|
22 |
+
- Loss: 1.6258
|
23 |
+
- Rouge1: 0.4708
|
24 |
+
- Rouge2: 0.2214
|
25 |
+
- Rougel: 0.3861
|
26 |
+
- Rougelsum: 0.3863
|
27 |
+
- Gen Len: 26.5411
|
28 |
+
- Precision: 0.9108
|
29 |
+
- Recall: 0.9093
|
30 |
+
- F1: 0.9099
|
31 |
|
32 |
## Model description
|
33 |
|
|
|
54 |
- total_train_batch_size: 128
|
55 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
56 |
- lr_scheduler_type: linear
|
57 |
+
- num_epochs: 20
|
58 |
- mixed_precision_training: Native AMP
|
59 |
|
60 |
### Training results
|
|
|
72 |
| 1.7559 | 9.0 | 3511 | 0.9086 | 26.424 | 1.6662 | 0.9098 | 0.9078 | 0.4632 | 0.215 | 0.38 | 0.3799 |
|
73 |
| 1.7559 | 10.0 | 3902 | 0.9089 | 26.5425 | 1.6594 | 0.9099 | 0.9082 | 0.4651 | 0.2168 | 0.3812 | 0.3812 |
|
74 |
| 1.7357 | 11.0 | 4293 | 0.9091 | 26.6051 | 1.6555 | 0.91 | 0.9086 | 0.4663 | 0.2178 | 0.3824 | 0.3823 |
|
75 |
+
| 1.7297 | 12.0 | 4680 | 0.9092 | 26.4393 | 1.6508 | 0.9103 | 0.9084 | 0.4668 | 0.2175 | 0.3823 | 0.3822 |
|
76 |
+
| 1.7165 | 13.0 | 5071 | 0.9094 | 26.6385 | 1.6451 | 0.9103 | 0.9089 | 0.4687 | 0.2191 | 0.3834 | 0.3834 |
|
77 |
+
| 1.7165 | 14.0 | 5462 | 0.9095 | 26.4156 | 1.6405 | 0.9106 | 0.9087 | 0.4691 | 0.2193 | 0.3845 | 0.3844 |
|
78 |
+
| 1.7068 | 15.0 | 5853 | 0.9097 | 26.4571 | 1.6383 | 0.9108 | 0.9089 | 0.4699 | 0.2204 | 0.3853 | 0.3853 |
|
79 |
+
| 1.7004 | 16.0 | 6240 | 1.6346 | 0.4703 | 0.2204 | 0.385 | 0.385 | 26.4247| 0.9108 | 0.9089 | 0.9097 |
|
80 |
+
| 1.6923 | 17.0 | 6631 | 1.6305 | 0.4706 | 0.221 | 0.3855 | 0.3856 | 26.4436| 0.911 | 0.9091 | 0.9099 |
|
81 |
+
| 1.6839 | 18.0 | 7022 | 1.6285 | 0.4712 | 0.2215 | 0.3862 | 0.3864 | 26.612 | 0.9106 | 0.9094 | 0.9098 |
|
82 |
+
| 1.6839 | 19.0 | 7413 | 1.6263 | 0.4709 | 0.2217 | 0.3862 | 0.3864 | 26.5291| 0.9108 | 0.9093 | 0.9099 |
|
83 |
+
| 1.6743 | 19.99 | 7800 | 1.6258 | 0.4708 | 0.2214 | 0.3861 | 0.3863 | 26.5411| 0.9108 | 0.9093 | 0.9099 |
|
84 |
|
85 |
|
86 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 2279458540
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:24428b056d93ffab03da9deca758d406c4550aa2a877b56ca1d102fd13435d43
|
3 |
size 2279458540
|
runs/Mar03_00-18-25_oi5vv8ctr1709312124223-tkfr5/events.out.tfevents.1709396321.oi5vv8ctr1709312124223-tkfr5.29206.0
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:47f7c57ab1645b195e2bbdb0459675918087fd044a352ac479efff9e938e15df
|
3 |
+
size 9480
|