Hugging Face's logo

desarrolloasesoreslocales
/
bert-leg-al-corpus

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
desarrolloasesoreslocales commited on
Commit
3373d39
•
1 Parent(s): a55a1e9

End of training

Browse files
Files changed (4) hide show
  1. README.md +11 -20
  2. model.safetensors +1 -1
  3. runs/Jun11_11-40-59_c8f541ed954c/events.out.tfevents.1718106063.c8f541ed954c.2089.6 +2 -2
  4. runs/Jun11_11-40-59_c8f541ed954c/events.out.tfevents.1718107206.c8f541ed954c.2089.7 +3 -0
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  license: cc
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: joelniklaus/legal-xlm-roberta-base
6
  model-index:
7
  - name: bert-leg-al-corpus
8
  results: []
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [joelniklaus/legal-xlm-roberta-base](https://huggingface.co/joelniklaus/legal-xlm-roberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.6747
19
 
20
  ## Model description
21
 
@@ -35,33 +35,24 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-06
38
- - train_batch_size: 24
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 10
44
- - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:------:|:----:|:---------------:|
50
- | 1.9151 | 0.6329 | 100 | 1.7846 |
51
- | 1.9038 | 1.2658 | 200 | 1.7245 |
52
- | 1.8655 | 1.8987 | 300 | 1.7416 |
53
- | 1.8712 | 2.5316 | 400 | 1.7254 |
54
- | 1.8463 | 3.1646 | 500 | 1.7038 |
55
- | 1.845 | 3.7975 | 600 | 1.6799 |
56
- | 1.833 | 4.4304 | 700 | 1.6712 |
57
- | 1.8196 | 5.0633 | 800 | 1.6761 |
58
- | 1.8104 | 5.6962 | 900 | 1.6445 |
59
- | 1.8017 | 6.3291 | 1000 | 1.6668 |
60
- | 1.7986 | 6.9620 | 1100 | 1.6449 |
61
- | 1.7955 | 7.5949 | 1200 | 1.6463 |
62
- | 1.8045 | 8.2278 | 1300 | 1.6303 |
63
- | 1.7817 | 8.8608 | 1400 | 1.6212 |
64
- | 1.7831 | 9.4937 | 1500 | 1.6477 |
65
 
66
 
67
  ### Framework versions
 
1
  ---
2
  license: cc
3
+ base_model: joelniklaus/legal-xlm-roberta-base
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: bert-leg-al-corpus
8
  results: []
 
15
 
16
  This model is a fine-tuned version of [joelniklaus/legal-xlm-roberta-base](https://huggingface.co/joelniklaus/legal-xlm-roberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.8436
19
 
20
  ## Model description
21
 
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-06
38
+ - train_batch_size: 16
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 3
 
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:------:|:----:|:---------------:|
49
+ | 1.9469 | 0.4219 | 100 | 1.8536 |
50
+ | 1.9311 | 0.8439 | 200 | 1.8405 |
51
+ | 1.9608 | 1.2658 | 300 | 1.8464 |
52
+ | 1.9217 | 1.6878 | 400 | 1.8155 |
53
+ | 1.9213 | 2.1097 | 500 | 1.8155 |
54
+ | 1.9213 | 2.5316 | 600 | 1.8239 |
55
+ | 1.9552 | 2.9536 | 700 | 1.8140 |
 
 
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9a3cf3a31beda5bd018c20c4f60662c7c27d2fb966baa356250c698f9d45adc
3
  size 737926808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:926fb44cb6d904e1652a4285aa59ab234ae4a2e35227a1b0d63fbbc36474ea8f
3
  size 737926808
runs/Jun11_11-40-59_c8f541ed954c/events.out.tfevents.1718106063.c8f541ed954c.2089.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:817a93855f8e09d645afe74f6180b36139d13ef3da0e482b6806d9bac03ea1ba
3
- size 8229
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3336621b870ab65210482cd6bb230bb0b686d094f2a5dfffb52279a2aa811e44
3
+ size 8583
runs/Jun11_11-40-59_c8f541ed954c/events.out.tfevents.1718107206.c8f541ed954c.2089.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53f8225eef321c965fee49ff7beed04c9944b3f0aae846a1ee1ef87535b40be8
3
+ size 359