End of training

README.md

@@ -1,8 +1,8 @@
 ---
-license: mit
+license: cc
+base_model: joelniklaus/legal-xlm-roberta-base
 tags:
 - generated_from_trainer
-base_model: desarrolloasesoreslocales/bert-leg-al-corpus
 model-index:
 - name: bert-leg-al-corpus
   results: []
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # bert-leg-al-corpus
 
-This model is a fine-tuned version of [desarrolloasesoreslocales/bert-leg-al-corpus](https://huggingface.co/desarrolloasesoreslocales/bert-leg-al-corpus) on the None dataset.
+This model is a fine-tuned version of [joelniklaus/legal-xlm-roberta-base](https://huggingface.co/joelniklaus/legal-xlm-roberta-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.1091
+- Loss: 1.8639
 
 ## Model description
 
@@ -34,33 +34,31 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
-- train_batch_size: 16
+- learning_rate: 2e-06
+- train_batch_size: 24
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 10
+- num_epochs: 5
+- mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 120  | 2.1589          |
-| No log        | 2.0   | 240  | 2.1450          |
-| No log        | 3.0   | 360  | 2.1474          |
-| No log        | 4.0   | 480  | 2.1235          |
-| 2.3496        | 5.0   | 600  | 2.1529          |
-| 2.3496        | 6.0   | 720  | 2.1309          |
-| 2.3496        | 7.0   | 840  | 2.1170          |
-| 2.3496        | 8.0   | 960  | 2.1386          |
-| 2.297         | 9.0   | 1080 | 2.1235          |
-| 2.297         | 10.0  | 1200 | 2.1109          |
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 2.408         | 0.6329 | 100  | 2.0952          |
+| 2.1264        | 1.2658 | 200  | 1.9866          |
+| 2.0701        | 1.8987 | 300  | 1.9136          |
+| 2.0156        | 2.5316 | 400  | 1.8920          |
+| 2.004         | 3.1646 | 500  | 1.8745          |
+| 1.9702        | 3.7975 | 600  | 1.8537          |
+| 1.9569        | 4.4304 | 700  | 1.8493          |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
-- Pytorch 2.2.1+cu121
-- Datasets 2.18.0
-- Tokenizers 0.15.2
+- Transformers 4.41.2
+- Pytorch 2.3.0+cu121
+- Datasets 2.19.2
+- Tokenizers 0.19.1

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f97ce60620696d024608a6e6439cbc077428e8b6123a041838e2fb250a443c0
+oid sha256:d36b657daac6314c2d87984570803edacc1d6372ba6d0e517a13450aa9a06ccc
 size 737926808

runs/Jun11_08-21-38_5be8417a0bdc/events.out.tfevents.1718094105.5be8417a0bdc.11033.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:215c1821dcb76fc02e7458df9ca8c94ef0f37578c79c16912aca25c8774f54c4
-size 8228
+oid sha256:b14d7d263baf3f57485f3ce8515b17929bcfe3b14713add8945c688ed8b8990a
+size 8582

runs/Jun11_08-21-38_5be8417a0bdc/events.out.tfevents.1718094513.5be8417a0bdc.11033.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de26a0e0486b750195188df920f70c9f79cabee61986c05145af7849d4dc10b0
+size 359