SimoneJLaudani
commited on
Commit
•
6accbfd
1
Parent(s):
22c9bd8
End of training
Browse files- README.md +28 -4
- config.json +1 -0
- model.safetensors +1 -1
- runs/Mar22_22-13-23_82585ee6d668/events.out.tfevents.1711145843.82585ee6d668.199.5 +3 -0
- runs/Mar22_22-23-37_82585ee6d668/events.out.tfevents.1711146222.82585ee6d668.199.6 +3 -0
- runs/Mar22_22-23-55_82585ee6d668/events.out.tfevents.1711146237.82585ee6d668.199.7 +3 -0
- runs/Mar22_22-26-26_82585ee6d668/events.out.tfevents.1711146391.82585ee6d668.199.8 +3 -0
- runs/Mar22_22-28-18_82585ee6d668/events.out.tfevents.1711146502.82585ee6d668.199.9 +3 -0
- runs/Mar22_22-29-09_82585ee6d668/events.out.tfevents.1711146555.82585ee6d668.199.10 +3 -0
- runs/Mar22_22-31-14_82585ee6d668/events.out.tfevents.1711146683.82585ee6d668.199.11 +3 -0
- runs/Mar22_22-34-42_82585ee6d668/events.out.tfevents.1711146887.82585ee6d668.199.12 +3 -0
- runs/Mar22_22-37-24_82585ee6d668/events.out.tfevents.1711147049.82585ee6d668.199.13 +3 -0
- runs/Mar22_22-38-23_82585ee6d668/events.out.tfevents.1711147108.82585ee6d668.199.14 +3 -0
- runs/Mar22_22-39-16_82585ee6d668/events.out.tfevents.1711147162.82585ee6d668.199.15 +3 -0
- runs/Mar22_22-44-20_82585ee6d668/events.out.tfevents.1711147465.82585ee6d668.199.16 +3 -0
- runs/Mar22_22-48-07_82585ee6d668/events.out.tfevents.1711147694.82585ee6d668.199.17 +3 -0
- runs/Mar22_22-48-47_82585ee6d668/events.out.tfevents.1711147731.82585ee6d668.199.18 +3 -0
- runs/Mar22_23-03-22_82585ee6d668/events.out.tfevents.1711148609.82585ee6d668.199.19 +3 -0
- runs/Mar22_23-04-24_82585ee6d668/events.out.tfevents.1711148669.82585ee6d668.199.20 +3 -0
- runs/Mar22_23-05-10_82585ee6d668/events.out.tfevents.1711148716.82585ee6d668.199.21 +3 -0
- runs/Mar22_23-06-27_82585ee6d668/events.out.tfevents.1711148793.82585ee6d668.199.22 +3 -0
- runs/Mar22_23-07-40_82585ee6d668/events.out.tfevents.1711148868.82585ee6d668.199.23 +3 -0
- runs/Mar22_23-10-25_82585ee6d668/events.out.tfevents.1711149031.82585ee6d668.199.24 +3 -0
- runs/Mar22_23-11-13_82585ee6d668/events.out.tfevents.1711149079.82585ee6d668.199.25 +3 -0
- runs/Mar22_23-23-36_82585ee6d668/events.out.tfevents.1711149823.82585ee6d668.199.26 +3 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -3,6 +3,11 @@ license: apache-2.0
|
|
3 |
base_model: distilbert-base-uncased
|
4 |
tags:
|
5 |
- generated_from_trainer
|
|
|
|
|
|
|
|
|
|
|
6 |
model-index:
|
7 |
- name: trainerH
|
8 |
results: []
|
@@ -14,6 +19,12 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
# trainerH
|
15 |
|
16 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
## Model description
|
19 |
|
@@ -32,13 +43,26 @@ More information needed
|
|
32 |
### Training hyperparameters
|
33 |
|
34 |
The following hyperparameters were used during training:
|
35 |
-
- learning_rate:
|
36 |
-
- train_batch_size:
|
37 |
-
- eval_batch_size:
|
38 |
- seed: 42
|
39 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
40 |
- lr_scheduler_type: linear
|
41 |
-
- num_epochs:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
|
43 |
### Framework versions
|
44 |
|
|
|
3 |
base_model: distilbert-base-uncased
|
4 |
tags:
|
5 |
- generated_from_trainer
|
6 |
+
metrics:
|
7 |
+
- precision
|
8 |
+
- recall
|
9 |
+
- f1
|
10 |
+
- accuracy
|
11 |
model-index:
|
12 |
- name: trainerH
|
13 |
results: []
|
|
|
19 |
# trainerH
|
20 |
|
21 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
22 |
+
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 0.6698
|
24 |
+
- Precision: 0.7712
|
25 |
+
- Recall: 0.7675
|
26 |
+
- F1: 0.7666
|
27 |
+
- Accuracy: 0.7675
|
28 |
|
29 |
## Model description
|
30 |
|
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
+
- learning_rate: 2e-05
|
47 |
+
- train_batch_size: 64
|
48 |
+
- eval_batch_size: 64
|
49 |
- seed: 42
|
50 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
51 |
- lr_scheduler_type: linear
|
52 |
+
- num_epochs: 8
|
53 |
+
|
54 |
+
### Training results
|
55 |
+
|
56 |
+
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
57 |
+
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
58 |
+
| 1.5988 | 1.07 | 30 | 1.4178 | 0.5664 | 0.5546 | 0.5376 | 0.5546 |
|
59 |
+
| 1.2041 | 2.14 | 60 | 1.0819 | 0.7207 | 0.7115 | 0.7044 | 0.7115 |
|
60 |
+
| 0.9136 | 3.21 | 90 | 0.9019 | 0.7333 | 0.7283 | 0.7247 | 0.7283 |
|
61 |
+
| 0.7129 | 4.29 | 120 | 0.7956 | 0.7549 | 0.7479 | 0.7443 | 0.7479 |
|
62 |
+
| 0.5666 | 5.36 | 150 | 0.7209 | 0.7689 | 0.7647 | 0.7626 | 0.7647 |
|
63 |
+
| 0.4664 | 6.43 | 180 | 0.6858 | 0.7697 | 0.7647 | 0.7634 | 0.7647 |
|
64 |
+
| 0.4267 | 7.5 | 210 | 0.6698 | 0.7712 | 0.7675 | 0.7666 | 0.7675 |
|
65 |
+
|
66 |
|
67 |
### Framework versions
|
68 |
|
config.json
CHANGED
@@ -32,6 +32,7 @@
|
|
32 |
"n_heads": 12,
|
33 |
"n_layers": 6,
|
34 |
"pad_token_id": 0,
|
|
|
35 |
"qa_dropout": 0.1,
|
36 |
"seq_classif_dropout": 0.2,
|
37 |
"sinusoidal_pos_embds": false,
|
|
|
32 |
"n_heads": 12,
|
33 |
"n_layers": 6,
|
34 |
"pad_token_id": 0,
|
35 |
+
"problem_type": "single_label_classification",
|
36 |
"qa_dropout": 0.1,
|
37 |
"seq_classif_dropout": 0.2,
|
38 |
"sinusoidal_pos_embds": false,
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 267847948
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bdc1c6f67936877cd44c672ba711bd31988f5fe32c1e160c35a682193819a3cf
|
3 |
size 267847948
|
runs/Mar22_22-13-23_82585ee6d668/events.out.tfevents.1711145843.82585ee6d668.199.5
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:37b0db40659e18519b0ec5a68c510b07de447e5d8d459c41bda550827bf1bc53
|
3 |
+
size 4778
|
runs/Mar22_22-23-37_82585ee6d668/events.out.tfevents.1711146222.82585ee6d668.199.6
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:776b6a2bad45ab3215c8c63f9c57539fe97eb31c0becc941e6c4e04fbceba2a9
|
3 |
+
size 4827
|
runs/Mar22_22-23-55_82585ee6d668/events.out.tfevents.1711146237.82585ee6d668.199.7
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d1f65fd2eb4eac06fe75cf65561dbd85d73b6839997c608f22986de9bb5d93cd
|
3 |
+
size 4825
|
runs/Mar22_22-26-26_82585ee6d668/events.out.tfevents.1711146391.82585ee6d668.199.8
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c3d4d8505d91ed50b02886920819ba0dde5cea49fd095b229094b0fd645675c0
|
3 |
+
size 4825
|
runs/Mar22_22-28-18_82585ee6d668/events.out.tfevents.1711146502.82585ee6d668.199.9
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d835ad1ef8897cbe46bf73b4a00dd1867caf97bf9375df0e80e4ccd51a96542a
|
3 |
+
size 4776
|
runs/Mar22_22-29-09_82585ee6d668/events.out.tfevents.1711146555.82585ee6d668.199.10
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:770d0478b0a4e35aeae0f1ecfd75abb5c2f70ab2b01be3845aec7b64f22e83e6
|
3 |
+
size 4962
|
runs/Mar22_22-31-14_82585ee6d668/events.out.tfevents.1711146683.82585ee6d668.199.11
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4db661b76f9184b847d9e675a410e521b8f232025b8b1fbfa45f6dbd7b7cf623
|
3 |
+
size 4778
|
runs/Mar22_22-34-42_82585ee6d668/events.out.tfevents.1711146887.82585ee6d668.199.12
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:09c5a8d1917fbc653fe0f28ae2dbe3cae908f5baa543e3a7e1a04df8467c4f17
|
3 |
+
size 4778
|
runs/Mar22_22-37-24_82585ee6d668/events.out.tfevents.1711147049.82585ee6d668.199.13
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9671917d2275bffb0ac967eb17d7cd94628dc9c6346fa1b79a3e80e86ef223a5
|
3 |
+
size 4778
|
runs/Mar22_22-38-23_82585ee6d668/events.out.tfevents.1711147108.82585ee6d668.199.14
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:39d5d6b7b18cfdedc82186daefba2677dd7a618888f16de4310bdfa0916ab04b
|
3 |
+
size 4778
|
runs/Mar22_22-39-16_82585ee6d668/events.out.tfevents.1711147162.82585ee6d668.199.15
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a287264f26909334076b1bbeb6366400356587df4ad7b4f1fb0289a9268f133b
|
3 |
+
size 5427
|
runs/Mar22_22-44-20_82585ee6d668/events.out.tfevents.1711147465.82585ee6d668.199.16
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ff3364301182f970c853259e1c9c97d984b49157197658375b507d84491d159f
|
3 |
+
size 4778
|
runs/Mar22_22-48-07_82585ee6d668/events.out.tfevents.1711147694.82585ee6d668.199.17
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3e75c915f2b6ee66534e917d6baa0fd700a24490bbdde6ac0539e76c67b87545
|
3 |
+
size 4789
|
runs/Mar22_22-48-47_82585ee6d668/events.out.tfevents.1711147731.82585ee6d668.199.18
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:da014c114f6f4b822aeba95cd6706447d735239e1c8c0ecaffc2e9e7eca3bfae
|
3 |
+
size 5438
|
runs/Mar22_23-03-22_82585ee6d668/events.out.tfevents.1711148609.82585ee6d668.199.19
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9ce6b4822617bfa7e1fe9f8cbb6d7d2904ff2571e012ec5916b3270b9dd3082c
|
3 |
+
size 4867
|
runs/Mar22_23-04-24_82585ee6d668/events.out.tfevents.1711148669.82585ee6d668.199.20
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:61adbf65d3d0a812ebf31314573b3806b837de6e36bdb3b66be066cc40e02a9f
|
3 |
+
size 4778
|
runs/Mar22_23-05-10_82585ee6d668/events.out.tfevents.1711148716.82585ee6d668.199.21
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:95beee7ab6505eb6535b97f11d54a8a9e9c678ad98677e1411d446de3cd6d5b4
|
3 |
+
size 4757
|
runs/Mar22_23-06-27_82585ee6d668/events.out.tfevents.1711148793.82585ee6d668.199.22
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f674411b8ffa1d2bc36f24483af57ef6c46b8cf75e8cb7da47075784d1f99170
|
3 |
+
size 4806
|
runs/Mar22_23-07-40_82585ee6d668/events.out.tfevents.1711148868.82585ee6d668.199.23
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:53aba65fba3d3340d7b98e185fba996492c09d8800fcae6b7aac06942c7cc21a
|
3 |
+
size 4806
|
runs/Mar22_23-10-25_82585ee6d668/events.out.tfevents.1711149031.82585ee6d668.199.24
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:df4c31d3c39758e2c9a2d8f2328b2e38409a3642607752930b0b8c9faea5c44e
|
3 |
+
size 4778
|
runs/Mar22_23-11-13_82585ee6d668/events.out.tfevents.1711149079.82585ee6d668.199.25
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0e6e3de47ebb7704a1be4b424d676d67947baa7f99a7b25b75b32fa48bc66413
|
3 |
+
size 5427
|
runs/Mar22_23-23-36_82585ee6d668/events.out.tfevents.1711149823.82585ee6d668.199.26
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ab59f6fb1ec7e5b87a3f184340112277e09a2fecab7772abc63c9f2b8f9b05c7
|
3 |
+
size 9889
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4920
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1c9e704479209c1027a5e5144c082532e5fe882e9363aab60ead9e7e7bef0cd4
|
3 |
size 4920
|