MultiPRIDE-DualEncoder-LPFT-it

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [nickprock/setfit-italian-hate-speech](https://huggingface.co/nickprock/setfit-italian-hate-speech) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0299
-- Accuracy: 0.9080
-- F1: 0.7619
-- Precision: 0.75
-- Recall: 0.7742
+- Loss: 0.0105
+- Accuracy: 0.9693
+- F1: 0.9180
+- Precision: 0.9333
+- Recall: 0.9032
 
 ## Model description
 
@@ -47,7 +47,7 @@ The following hyperparameters were used during training:
 - learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
-- seed: 150
+- seed: 1337
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 10
@@ -56,12 +56,15 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 0.2105        | 1.0   | 95   | 0.1445          | 0.7914   | 0.32   | 0.4211    | 0.2581 |
-| 0.1483        | 2.0   | 190  | 0.0919          | 0.8650   | 0.6452 | 0.6452    | 0.6452 |
-| 0.095         | 3.0   | 285  | 0.0521          | 0.9202   | 0.7869 | 0.8       | 0.7742 |
-| 0.0505        | 4.0   | 380  | 0.0327          | 0.9018   | 0.7576 | 0.7143    | 0.8065 |
-| 0.0361        | 5.0   | 475  | 0.0309          | 0.8957   | 0.7302 | 0.7188    | 0.7419 |
-| 0.0305        | 6.0   | 570  | 0.0299          | 0.9080   | 0.7619 | 0.75      | 0.7742 |
+| 0.1597        | 1.0   | 95   | 0.1206          | 0.8528   | 0.5385 | 0.6667    | 0.4516 |
+| 0.1218        | 2.0   | 190  | 0.0621          | 0.8834   | 0.7077 | 0.6765    | 0.7419 |
+| 0.0744        | 3.0   | 285  | 0.0270          | 0.9387   | 0.8438 | 0.8182    | 0.8710 |
+| 0.0431        | 4.0   | 380  | 0.0167          | 0.9632   | 0.9032 | 0.9032    | 0.9032 |
+| 0.0393        | 5.0   | 475  | 0.0128          | 0.9571   | 0.8889 | 0.875     | 0.9032 |
+| 0.0223        | 6.0   | 570  | 0.0116          | 0.9693   | 0.9180 | 0.9333    | 0.9032 |
+| 0.0432        | 7.0   | 665  | 0.0108          | 0.9693   | 0.9180 | 0.9333    | 0.9032 |
+| 0.0348        | 8.0   | 760  | 0.0105          | 0.9693   | 0.9180 | 0.9333    | 0.9032 |
+| 0.035         | 9.0   | 855  | 0.0105          | 0.9693   | 0.9180 | 0.9333    | 0.9032 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e961c593990cec98b799de8f5224ba1405d08b9e42c59eeaaabe08e49de1fdd0
+oid sha256:1ddb945708cd1392bc9b04e2056796711e1103a784e6f2c57b0bc2dd9b235402
 size 443306324

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7f3315cfa5b132b1ea873f6888f3c3f86e277a102cf339979d8216b7672e4a69
+oid sha256:2e2e512427e7520a875e7508a43a56a444f1a41a40a7d1c60cbc77f66fafd97c
 size 5969