Hugging Face's logo

dtorber
/
bertweet-base

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
dtorber commited on
Commit
4b4d291
•
1 Parent(s): e753197

Model save

Browse files
Files changed (2) hide show
  1. README.md +14 -12
  2. model.safetensors +1 -1
README.md CHANGED
@@ -17,14 +17,14 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5690
21
- - F1 Macro: 0.7699
22
- - F1: 0.8459
23
- - F1 Neg: 0.6940
24
- - Acc: 0.795
25
- - Prec: 0.8152
26
- - Recall: 0.8789
27
- - Mcc: 0.5446
28
 
29
  ## Model description
30
 
@@ -50,16 +50,18 @@ The following hyperparameters were used during training:
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - num_epochs: 3
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
- | 0.6752 | 1.0 | 592 | 0.6373 | 0.5685 | 0.8134 | 0.3237 | 0.7075 | 0.6873 | 0.9961 | 0.3527 |
61
- | 0.4957 | 2.0 | 1184 | 0.7489 | 0.7577 | 0.8122 | 0.7032 | 0.77 | 0.8504 | 0.7773 | 0.5205 |
62
- | 0.4233 | 3.0 | 1776 | 0.5690 | 0.7699 | 0.8459 | 0.6940 | 0.795 | 0.8152 | 0.8789 | 0.5446 |
 
 
63
 
64
 
65
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.7685
21
+ - F1 Macro: 0.8269
22
+ - F1: 0.8697
23
+ - F1 Neg: 0.7841
24
+ - Acc: 0.8375
25
+ - Prec: 0.8930
26
+ - Recall: 0.8477
27
+ - Mcc: 0.6558
28
 
29
  ## Model description
30
 
 
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
+ | 0.6468 | 1.0 | 592 | 0.5371 | 0.7329 | 0.8451 | 0.6207 | 0.78 | 0.7692 | 0.9375 | 0.5069 |
61
+ | 0.454 | 2.0 | 1184 | 0.5912 | 0.7849 | 0.8419 | 0.7279 | 0.8 | 0.852 | 0.8320 | 0.5702 |
62
+ | 0.4138 | 3.0 | 1776 | 0.6924 | 0.7853 | 0.8685 | 0.7020 | 0.8175 | 0.8060 | 0.9414 | 0.5951 |
63
+ | 0.3396 | 4.0 | 2368 | 0.7403 | 0.8233 | 0.8577 | 0.7888 | 0.83 | 0.9234 | 0.8008 | 0.6594 |
64
+ | 0.3215 | 5.0 | 2960 | 0.7685 | 0.8269 | 0.8697 | 0.7841 | 0.8375 | 0.8930 | 0.8477 | 0.6558 |
65
 
66
 
67
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f60ec0f95be73469ca34c456741a1fcfc3d6a8423332d792ad6880063544f2f0
3
  size 539629568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0866e7196669d3f584969f53aca3a6189b5880b74152648c7217fa26128cfb1e
3
  size 539629568