Hugging Face's logo

taoyoung
/
xlm-roberta-base-finetuned-panx-de-fr

Token Classification
Transformers
Safetensors
xlm-roberta
Generated from Trainer
Inference Endpoints
Model card Files Community
taoyoung commited on
Commit
9037a9c
•
1 Parent(s): 50f9a73

Training completed!

Browse files
Files changed (4) hide show
  1. README.md +9 -9
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.1639
21
- - F1: 0.8591
22
 
23
  ## Model description
24
 
@@ -38,8 +38,8 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 5e-05
41
- - train_batch_size: 24
42
- - eval_batch_size: 24
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
@@ -49,14 +49,14 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | F1 |
51
  |:-------------:|:-----:|:----:|:---------------:|:------:|
52
- | 0.2836 | 1.0 | 715 | 0.1859 | 0.8212 |
53
- | 0.1484 | 2.0 | 1430 | 0.1632 | 0.8487 |
54
- | 0.0953 | 3.0 | 2145 | 0.1639 | 0.8591 |
55
 
56
 
57
  ### Framework versions
58
 
59
- - Transformers 4.38.2
60
- - Pytorch 2.2.1+cu121
61
  - Datasets 2.18.0
62
  - Tokenizers 0.15.2
 
17
 
18
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.1881
21
+ - F1: 0.8633
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 5e-05
41
+ - train_batch_size: 8
42
+ - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | F1 |
51
  |:-------------:|:-----:|:----:|:---------------:|:------:|
52
+ | 0.2897 | 1.0 | 2145 | 0.2041 | 0.8183 |
53
+ | 0.1619 | 2.0 | 4290 | 0.1899 | 0.8482 |
54
+ | 0.1039 | 3.0 | 6435 | 0.1881 | 0.8633 |
55
 
56
 
57
  ### Framework versions
58
 
59
+ - Transformers 4.39.3
60
+ - Pytorch 2.2.2+cu118
61
  - Datasets 2.18.0
62
  - Tokenizers 0.15.2
config.json CHANGED
@@ -40,7 +40,7 @@
40
  "pad_token_id": 1,
41
  "position_embedding_type": "absolute",
42
  "torch_dtype": "float32",
43
- "transformers_version": "4.38.2",
44
  "type_vocab_size": 1,
45
  "use_cache": true,
46
  "vocab_size": 250002
 
40
  "pad_token_id": 1,
41
  "position_embedding_type": "absolute",
42
  "torch_dtype": "float32",
43
+ "transformers_version": "4.39.3",
44
  "type_vocab_size": 1,
45
  "use_cache": true,
46
  "vocab_size": 250002
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ed8bf9bd508ddd4f4732cd4c52b48ee7f5275325e5af70d304660c111ae074b3
3
  size 1109860880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c66fe846d3824a603d2755cbc636e00d99621672094f0da2572d8812ae24da10
3
  size 1109860880
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f50f8162b0992a72a7435a32d0986f29fc3499deb319f2eec5e13096d8eb3e35
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd88d22212520f83e87f93105c061468e08a3f8a5aed16fb20b47114ff64ba57
3
  size 4984