hhffxx commited on
Commit
16a35dd
1 Parent(s): 2e69797

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -11
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.1628
20
- - F1: 0.8593
21
 
22
  ## Model description
23
 
@@ -37,25 +37,32 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 5e-05
40
- - train_batch_size: 24
41
- - eval_batch_size: 24
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 3
46
 
47
  ### Training results
48
 
49
- | Training Loss | Epoch | Step | Validation Loss | F1 |
50
- |:-------------:|:-----:|:----:|:---------------:|:------:|
51
- | 0.2913 | 1.0 | 715 | 0.1794 | 0.8302 |
52
- | 0.146 | 2.0 | 1430 | 0.1632 | 0.8506 |
53
- | 0.0945 | 3.0 | 2145 | 0.1628 | 0.8593 |
 
 
 
 
 
 
 
54
 
55
 
56
  ### Framework versions
57
 
58
  - Transformers 4.21.1
59
  - Pytorch 1.11.0
60
- - Datasets 2.3.0
61
  - Tokenizers 0.12.1
 
16
 
17
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.8299
20
+ - F1: 0.5812
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 5e-05
40
+ - train_batch_size: 1
41
+ - eval_batch_size: 1
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 10
46
 
47
  ### Training results
48
 
49
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
50
+ |:-------------:|:-----:|:------:|:---------------:|:------:|
51
+ | 1.0225 | 1.0 | 17160 | 0.8581 | 0.2009 |
52
+ | 0.8737 | 2.0 | 34320 | 0.9759 | 0.2485 |
53
+ | 0.7939 | 3.0 | 51480 | 0.8271 | 0.3923 |
54
+ | 0.7049 | 4.0 | 68640 | 0.8624 | 0.4401 |
55
+ | 0.6224 | 5.0 | 85800 | 0.7628 | 0.5075 |
56
+ | 0.5286 | 6.0 | 102960 | 0.7342 | 0.5185 |
57
+ | 0.4555 | 7.0 | 120120 | 0.7734 | 0.5370 |
58
+ | 0.3873 | 8.0 | 137280 | 0.7164 | 0.5646 |
59
+ | 0.3218 | 9.0 | 154440 | 0.8536 | 0.5756 |
60
+ | 0.2721 | 10.0 | 171600 | 0.8299 | 0.5812 |
61
 
62
 
63
  ### Framework versions
64
 
65
  - Transformers 4.21.1
66
  - Pytorch 1.11.0
67
+ - Datasets 2.4.0
68
  - Tokenizers 0.12.1