Hugging Face's logo

mehdie
/
fine_tuned_mBERT

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
morten-j commited on
Commit
cd12c6f
•
1 Parent(s): 7390abb

morten-j/fine_tuned_mBERT

Browse files
Files changed (15) hide show
  1. README.md +12 -16
  2. model.safetensors +1 -1
  3. runs/Apr09_13-27-38_yoga/events.out.tfevents.1712662059.yoga.35754.0 +3 -0
  4. runs/Apr09_13-27-38_yoga/events.out.tfevents.1712662195.yoga.35754.1 +3 -0
  5. runs/Apr09_13-31-40_yoga/events.out.tfevents.1712662300.yoga.35958.0 +3 -0
  6. runs/Apr09_13-31-40_yoga/events.out.tfevents.1712662326.yoga.35958.1 +3 -0
  7. runs/Apr09_13-33-48_yoga/events.out.tfevents.1712662429.yoga.36117.0 +3 -0
  8. runs/Apr09_13-33-48_yoga/events.out.tfevents.1712662534.yoga.36117.1 +3 -0
  9. runs/Apr09_13-36-32_yoga/events.out.tfevents.1712662592.yoga.36434.0 +3 -0
  10. runs/Apr09_13-36-32_yoga/events.out.tfevents.1712662672.yoga.36434.1 +3 -0
  11. runs/Apr09_13-40-10_yoga/events.out.tfevents.1712662811.yoga.36886.0 +3 -0
  12. runs/Apr09_13-40-10_yoga/events.out.tfevents.1712662889.yoga.36886.1 +3 -0
  13. runs/Apr09_13-41-53_yoga/events.out.tfevents.1712662913.yoga.37039.0 +3 -0
  14. runs/Apr09_13-41-53_yoga/events.out.tfevents.1712662993.yoga.37039.1 +3 -0
  15. training_args.bin +1 -1
README.md CHANGED
@@ -19,11 +19,11 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [google-bert/bert-base-multilingual-cased](https://huggingface.co/google-bert/bert-base-multilingual-cased) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.2019
23
- - F1: 0.6471
24
- - F5: 0.6062
25
- - Precision: 0.7857
26
- - Recall: 0.55
27
 
28
  ## Model description
29
 
@@ -48,23 +48,19 @@ The following hyperparameters were used during training:
48
  - seed: 42
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
- - num_epochs: 10
52
  - mixed_precision_training: Native AMP
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | F5 | Precision | Recall |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:---------:|:------:|
58
- | No log | 1.0 | 65 | 0.2513 | 0.0 | 0.0 | 0.0 | 0.0 |
59
- | No log | 2.0 | 130 | 0.1252 | 0.7143 | 0.7555 | 0.625 | 0.8333 |
60
- | No log | 3.0 | 195 | 0.4816 | 0.3736 | 0.4858 | 0.2329 | 0.9444 |
61
- | No log | 4.0 | 260 | 0.1049 | 0.7333 | 0.6813 | 0.9167 | 0.6111 |
62
- | No log | 5.0 | 325 | 0.1410 | 0.75 | 0.7798 | 0.6818 | 0.8333 |
63
- | No log | 6.0 | 390 | 0.0593 | 0.9189 | 0.9285 | 0.8947 | 0.9444 |
64
- | No log | 7.0 | 455 | 0.0733 | 0.8649 | 0.8739 | 0.8421 | 0.8889 |
65
- | 0.135 | 8.0 | 520 | 0.0959 | 0.8718 | 0.8982 | 0.8095 | 0.9444 |
66
- | 0.135 | 9.0 | 585 | 0.0761 | 0.9189 | 0.9285 | 0.8947 | 0.9444 |
67
- | 0.135 | 10.0 | 650 | 0.0763 | 0.9189 | 0.9285 | 0.8947 | 0.9444 |
68
 
69
 
70
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [google-bert/bert-base-multilingual-cased](https://huggingface.co/google-bert/bert-base-multilingual-cased) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.1259
23
+ - F1: 0.8182
24
+ - F5: 0.8326
25
+ - Precision: 0.7826
26
+ - Recall: 0.8571
27
 
28
  ## Model description
29
 
 
48
  - seed: 42
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
+ - num_epochs: 6
52
  - mixed_precision_training: Native AMP
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | F5 | Precision | Recall |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:---------:|:------:|
58
+ | No log | 1.0 | 65 | 0.2964 | 0.0 | 0.0 | 0.0 | 0.0 |
59
+ | No log | 2.0 | 130 | 0.2682 | 0.4737 | 0.4081 | 0.8182 | 0.3333 |
60
+ | No log | 3.0 | 195 | 0.2208 | 0.65 | 0.7421 | 0.4906 | 0.9630 |
61
+ | No log | 4.0 | 260 | 0.1924 | 0.7273 | 0.7816 | 0.6154 | 0.8889 |
62
+ | No log | 5.0 | 325 | 0.1246 | 0.8727 | 0.8788 | 0.8571 | 0.8889 |
63
+ | No log | 6.0 | 390 | 0.1142 | 0.8519 | 0.8519 | 0.8519 | 0.8519 |
 
 
 
 
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2c55a9a1078feb7f0e51bed96f72ffcde7e4bcc9c348f6a28824d262d7965e1
3
  size 711443456
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6632aae26df29eb412e0921d023a501f23ac7473aef97e73c9d3e3422adbd901
3
  size 711443456
runs/Apr09_13-27-38_yoga/events.out.tfevents.1712662059.yoga.35754.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d24dcbefbc21f5444db3597351bd811e964704bfa17f311a8c630618bd367abe
3
+ size 10054
runs/Apr09_13-27-38_yoga/events.out.tfevents.1712662195.yoga.35754.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46e60c7f28392c11b97c39fae10e898f28b2ccf5f2394136554fca5736a6ee37
3
+ size 554
runs/Apr09_13-31-40_yoga/events.out.tfevents.1712662300.yoga.35958.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58af8b5d497cb965a5740142dc1d739ac348ba462d27f7b4e40d427400b542e6
3
+ size 6114
runs/Apr09_13-31-40_yoga/events.out.tfevents.1712662326.yoga.35958.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2edd991c84e4ced0846b426dc4238a791dac190744ff578e8fa08cc0f9f0d1f
3
+ size 554
runs/Apr09_13-33-48_yoga/events.out.tfevents.1712662429.yoga.36117.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9886f9e854e38f5af1069b0745b28cfc72f326f1430705f7d4f443238cb80dd
3
+ size 9121
runs/Apr09_13-33-48_yoga/events.out.tfevents.1712662534.yoga.36117.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ea14107526ccf5d1e628bb1c83513187789354c01be74d01cb277367d9a8cbe
3
+ size 554
runs/Apr09_13-36-32_yoga/events.out.tfevents.1712662592.yoga.36434.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89fb9a0eb3709ed3cd9d02b170487b9d6baafa00c627b1698fcfea9f1b6a4327
3
+ size 7978
runs/Apr09_13-36-32_yoga/events.out.tfevents.1712662672.yoga.36434.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11bbf0087557ffb23e57f1805631e2724143a15514e3d600af0337d3ca304b68
3
+ size 554
runs/Apr09_13-40-10_yoga/events.out.tfevents.1712662811.yoga.36886.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4007fac4733d97a046ce3f64e6ccbb84633de9fa64ca15c579ae2638dbe74f9b
3
+ size 7975
runs/Apr09_13-40-10_yoga/events.out.tfevents.1712662889.yoga.36886.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20a057a0458be22a55228f449c73eed725bc534e695ff69604aa3c3c97c238b2
3
+ size 554
runs/Apr09_13-41-53_yoga/events.out.tfevents.1712662913.yoga.37039.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85b577c089f7c984d4600b6a4b9bec299798f005ef2a69d974114301e39f40e3
3
+ size 7975
runs/Apr09_13-41-53_yoga/events.out.tfevents.1712662993.yoga.37039.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a31409d9f1252ce396846ec92f93a331091bdd7e270ac60d9f7abd83fbe161fd
3
+ size 554
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af396597b8055d31701e051c7ddb9840ad914bd6ba5b02d23a570e585b4931cf
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee5163367b67a69c480e6a87aa8d438d5871aafdef5e493bbeb89f5be2527219
3
  size 4920