morten-j/fine_tuned_mBERT

README.md

@@ -19,11 +19,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google-bert/bert-base-multilingual-cased](https://huggingface.co/google-bert/bert-base-multilingual-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0784
-- F1: 0.8571
-- F5: 0.8730
-- Precision: 0.8182
-- Recall: 0.9
+- Loss: 0.1446
+- F1: 0.6190
+- F5: 0.6548
+- Precision: 0.5417
+- Recall: 0.7222
 
 ## Model description
 
@@ -55,16 +55,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | F1     | F5     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:---------:|:------:|
-| No log        | 1.0   | 65   | 0.2314          | 0.0    | 0.0    | 0.0       | 0.0    |
-| No log        | 2.0   | 130  | 0.2243          | 0.0    | 0.0    | 0.0       | 0.0    |
-| No log        | 3.0   | 195  | 0.2556          | 0.2105 | 0.2193 | 0.1905    | 0.2353 |
-| No log        | 4.0   | 260  | 0.2236          | 0.5    | 0.5627 | 0.3871    | 0.7059 |
-| No log        | 5.0   | 325  | 0.2295          | 0.4545 | 0.3762 | 1.0       | 0.2941 |
-| No log        | 6.0   | 390  | 0.2185          | 0.5    | 0.4313 | 0.8571    | 0.3529 |
-| No log        | 7.0   | 455  | 0.2666          | 0.5366 | 0.5740 | 0.4583    | 0.6471 |
-| 0.1993        | 8.0   | 520  | 0.1813          | 0.6429 | 0.5942 | 0.8182    | 0.5294 |
-| 0.1993        | 9.0   | 585  | 0.2069          | 0.6452 | 0.6222 | 0.7143    | 0.5882 |
-| 0.1993        | 10.0  | 650  | 0.2014          | 0.6897 | 0.6470 | 0.8333    | 0.5882 |
+| No log        | 1.0   | 65   | 0.3086          | 0.0    | 0.0    | 0.0       | 0.0    |
+| No log        | 2.0   | 130  | 0.2538          | 0.5352 | 0.6034 | 0.4130    | 0.76   |
+| No log        | 3.0   | 195  | 0.3520          | 0.3333 | 0.3107 | 0.4118    | 0.28   |
+| No log        | 4.0   | 260  | 0.1806          | 0.6531 | 0.6480 | 0.6667    | 0.64   |
+| No log        | 5.0   | 325  | 0.3014          | 0.5263 | 0.4697 | 0.7692    | 0.4    |
+| No log        | 6.0   | 390  | 0.2432          | 0.6667 | 0.6562 | 0.6957    | 0.64   |
+| No log        | 7.0   | 455  | 0.2808          | 0.7059 | 0.7112 | 0.6923    | 0.72   |
+| 0.1489        | 8.0   | 520  | 0.2133          | 0.76   | 0.76   | 0.76      | 0.76   |
+| 0.1489        | 9.0   | 585  | 0.2639          | 0.7692 | 0.7807 | 0.7407    | 0.8    |
+| 0.1489        | 10.0  | 650  | 0.3313          | 0.6809 | 0.6646 | 0.7273    | 0.64   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1cde3a614fff22c800e4b2637b25f03ee104cafce8595fc0631b49c37346e0c7
+oid sha256:89d5de37dda294b47cf4a029281cd8a0f27196c0da854c6e8620f04835647cc5
 size 711443456

runs/Apr02_10-52-17_yoga/events.out.tfevents.1712047937.yoga.22346.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c398846ce2d4df8ae00c0c66e9deb4e09aea24f00041f8234338f842066eb48
+size 10054

runs/Apr02_10-52-17_yoga/events.out.tfevents.1712048076.yoga.22346.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:102f2000eeef69fbf47c261452026d8e9bb31ee35f4e03984af4c4c7989bb19a
+size 554

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:33b365741720498d99ebbc02e12222b23bc4b33887441a7594f32a2778b6f503
+oid sha256:7887f4eec04bfe4c2394b2470c4db3ca2a23d4b754ae2d82ecdd8a9c3f279bab
 size 4920