Hugging Face's logo

RADAMSHI
/
xlm-roberta-base-finetuned-panx-all

Token Classification
Transformers
Safetensors
xlm-roberta
Generated from Trainer
Inference Endpoints
Model card Files Community
RADAMSHI commited on
Commit
6f114a0
•
1 Parent(s): 6bf329c

Training completed!

Browse files
Files changed (4) hide show
  1. README.md +8 -8
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.1758
21
- - F1: 0.8558
22
 
23
  ## Model description
24
 
@@ -38,8 +38,8 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 5e-05
41
- - train_batch_size: 24
42
- - eval_batch_size: 24
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
@@ -49,14 +49,14 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | F1 |
51
  |:-------------:|:-----:|:----:|:---------------:|:------:|
52
- | 0.299 | 1.0 | 835 | 0.2074 | 0.8078 |
53
- | 0.1587 | 2.0 | 1670 | 0.1705 | 0.8461 |
54
- | 0.1012 | 3.0 | 2505 | 0.1758 | 0.8558 |
55
 
56
 
57
  ### Framework versions
58
 
59
- - Transformers 4.41.1
60
  - Pytorch 2.3.0+cu121
61
  - Datasets 2.19.1
62
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.1851
21
+ - F1: 0.8544
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 5e-05
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | F1 |
51
  |:-------------:|:-----:|:----:|:---------------:|:------:|
52
+ | 0.2893 | 1.0 | 1252 | 0.2014 | 0.8148 |
53
+ | 0.1587 | 2.0 | 2504 | 0.1777 | 0.8427 |
54
+ | 0.1015 | 3.0 | 3756 | 0.1851 | 0.8544 |
55
 
56
 
57
  ### Framework versions
58
 
59
+ - Transformers 4.41.2
60
  - Pytorch 2.3.0+cu121
61
  - Datasets 2.19.1
62
  - Tokenizers 0.19.1
config.json CHANGED
@@ -40,7 +40,7 @@
40
  "pad_token_id": 1,
41
  "position_embedding_type": "absolute",
42
  "torch_dtype": "float32",
43
- "transformers_version": "4.41.1",
44
  "type_vocab_size": 1,
45
  "use_cache": true,
46
  "vocab_size": 250002
 
40
  "pad_token_id": 1,
41
  "position_embedding_type": "absolute",
42
  "torch_dtype": "float32",
43
+ "transformers_version": "4.41.2",
44
  "type_vocab_size": 1,
45
  "use_cache": true,
46
  "vocab_size": 250002
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b85f84cda32feb06821d204c12ff2c9dcd5bb4dfdbdb0f0ca45585e6e3b5e2fa
3
  size 1109860880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd1fae083a0e36d5545bb86787f8c3f59631f23ff2fc5443c1f85ec8eb96c0f2
3
  size 1109860880
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8ed778b8d266791d3e71b13fc32f2e83beeca268c6e9c2ac4664b27487201813
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a583006ee3acff765338688a92d9739a7783b25dc4cc9c9f35229476c77e02c4
3
  size 5176