File size: 16,678 Bytes
90bf665
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
---
license: mit
base_model: roberta-large
tags:
- generated_from_trainer
metrics:
- accuracy
- recall
- f1
model-index:
- name: lora-roberta-large-fine-emo
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# lora-roberta-large-fine-emo

This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7772
- Accuracy: 0.7230
- Prec: 0.6333
- Recall: 0.5894
- F1: 0.5987
- B Acc: 0.5894
- Prec Joy: 0.6716
- Recall Joy: 0.7385
- F1 Joy: 0.7035
- Prec Anger: 0.6341
- Recall Anger: 0.6310
- F1 Anger: 0.6326
- Prec Disgust: 0.5083
- Recall Disgust: 0.4375
- F1 Disgust: 0.4702
- Prec Fear: 0.6816
- Recall Fear: 0.6234
- F1 Fear: 0.6512
- Prec Neutral: 0.8272
- Recall Neutral: 0.8432
- F1 Neutral: 0.8351
- Prec Sadness: 0.6761
- Recall Sadness: 0.6133
- F1 Sadness: 0.6432
- Prec Surprise: 0.5690
- Recall Surprise: 0.4032
- F1 Surprise: 0.4720
- Prec Amusement: 0.7358
- Recall Amusement: 0.8548
- F1 Amusement: 0.7908
- Prec Anxiety: 0.4536
- Recall Anxiety: 0.4886
- F1 Anxiety: 0.4705
- Prec Guilt: 0.7860
- Recall Guilt: 0.7703
- F1 Guilt: 0.7781
- Prec Love: 0.6407
- Recall Love: 0.6273
- F1 Love: 0.6339
- Prec Optimism: 0.7153
- Recall Optimism: 0.6056
- F1 Optimism: 0.6559
- Prec Pessimism: 0.3333
- Recall Pessimism: 0.025
- F1 Pessimism: 0.0465

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 128
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 20.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Accuracy | Prec   | Recall | F1     | B Acc  | Prec Joy | Recall Joy | F1 Joy | Prec Anger | Recall Anger | F1 Anger | Prec Disgust | Recall Disgust | F1 Disgust | Prec Fear | Recall Fear | F1 Fear | Prec Neutral | Recall Neutral | F1 Neutral | Prec Sadness | Recall Sadness | F1 Sadness | Prec Surprise | Recall Surprise | F1 Surprise | Prec Amusement | Recall Amusement | F1 Amusement | Prec Anxiety | Recall Anxiety | F1 Anxiety | Prec Guilt | Recall Guilt | F1 Guilt | Prec Love | Recall Love | F1 Love | Prec Optimism | Recall Optimism | F1 Optimism | Prec Pessimism | Recall Pessimism | F1 Pessimism |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:--------:|:----------:|:------:|:----------:|:------------:|:--------:|:------------:|:--------------:|:----------:|:---------:|:-----------:|:-------:|:------------:|:--------------:|:----------:|:------------:|:--------------:|:----------:|:-------------:|:---------------:|:-----------:|:--------------:|:----------------:|:------------:|:------------:|:--------------:|:----------:|:----------:|:------------:|:--------:|:---------:|:-----------:|:-------:|:-------------:|:---------------:|:-----------:|:--------------:|:----------------:|:------------:|
| 1.0157        | 1.0   | 1756  | 0.9691          | 0.6663   | 0.5337 | 0.5038 | 0.5122 | 0.5038 | 0.6173   | 0.6805     | 0.6474 | 0.5681     | 0.4796       | 0.5201   | 0.4619       | 0.3893         | 0.4225     | 0.6567    | 0.4117      | 0.5061  | 0.8134       | 0.8269         | 0.8201     | 0.5633       | 0.56           | 0.5616     | 0.4613        | 0.3204          | 0.3782      | 0.6554         | 0.7657           | 0.7062       | 0.3637       | 0.5292         | 0.4311     | 0.7048     | 0.6130       | 0.6557   | 0.4626    | 0.5186      | 0.4890  | 0.6092        | 0.4538          | 0.5202      | 0.0            | 0.0              | 0.0          |
| 0.9186        | 2.0   | 3512  | 0.8979          | 0.6873   | 0.5497 | 0.5388 | 0.5376 | 0.5388 | 0.6239   | 0.7230     | 0.6698 | 0.5644     | 0.5817       | 0.5729   | 0.4373       | 0.4357         | 0.4365     | 0.5923    | 0.5743      | 0.5831  | 0.8235       | 0.8298         | 0.8266     | 0.6103       | 0.5373         | 0.5715     | 0.5451        | 0.2796          | 0.3696      | 0.5699         | 0.8746           | 0.6901       | 0.4437       | 0.4174         | 0.4302     | 0.7510     | 0.6872       | 0.7177   | 0.5687    | 0.5129      | 0.5393  | 0.6165        | 0.5509          | 0.5818      | 0.0            | 0.0              | 0.0          |
| 0.8686        | 3.0   | 5268  | 0.8550          | 0.6993   | 0.5880 | 0.5603 | 0.5700 | 0.5603 | 0.6758   | 0.6879     | 0.6818 | 0.5462     | 0.6339       | 0.5868   | 0.4386       | 0.4339         | 0.4363     | 0.6578    | 0.5485      | 0.5982  | 0.8159       | 0.8431         | 0.8293     | 0.6360       | 0.5707         | 0.6015     | 0.4874        | 0.3753          | 0.4241      | 0.6702         | 0.8251           | 0.7396       | 0.4647       | 0.4431         | 0.4537     | 0.8147     | 0.6600       | 0.7293   | 0.5840    | 0.5634      | 0.5735  | 0.6426        | 0.5994          | 0.6202      | 0.2105         | 0.1              | 0.1356       |
| 0.8386        | 4.0   | 7024  | 0.8276          | 0.7080   | 0.6131 | 0.5607 | 0.5805 | 0.5607 | 0.6812   | 0.6885     | 0.6848 | 0.6102     | 0.5716       | 0.5903   | 0.4691       | 0.4339         | 0.4508     | 0.6514    | 0.5813      | 0.6143  | 0.7868       | 0.8752         | 0.8286     | 0.6617       | 0.5702         | 0.6126     | 0.5489        | 0.3441          | 0.4230      | 0.7143         | 0.8251           | 0.7657       | 0.4824       | 0.4481         | 0.4646     | 0.7817     | 0.7251       | 0.7523   | 0.6292    | 0.5500      | 0.5870  | 0.6866        | 0.5759          | 0.6264      | 0.2667         | 0.1              | 0.1455       |
| 0.8125        | 5.0   | 8780  | 0.8200          | 0.7102   | 0.6011 | 0.5845 | 0.5887 | 0.5845 | 0.6745   | 0.7044     | 0.6891 | 0.6341     | 0.5779       | 0.6047   | 0.4914       | 0.4071         | 0.4453     | 0.7038    | 0.5836      | 0.6381  | 0.8196       | 0.8475         | 0.8333     | 0.6499       | 0.5858         | 0.6162     | 0.4950        | 0.4237          | 0.4565      | 0.6650         | 0.8845           | 0.7592       | 0.4218       | 0.5361         | 0.4721     | 0.7771     | 0.7251       | 0.7502   | 0.6509    | 0.5777      | 0.6121  | 0.6140        | 0.6197          | 0.6168      | 0.2174         | 0.125            | 0.1587       |
| 0.7981        | 6.0   | 10536 | 0.8111          | 0.7131   | 0.5989 | 0.5719 | 0.5793 | 0.5719 | 0.6839   | 0.6987     | 0.6912 | 0.6277     | 0.6090       | 0.6182   | 0.5151       | 0.3964         | 0.4480     | 0.6894    | 0.6023      | 0.6429  | 0.8023       | 0.8626         | 0.8313     | 0.7311       | 0.5231         | 0.6098     | 0.5577        | 0.3688          | 0.4440      | 0.6710         | 0.8548           | 0.7518       | 0.4138       | 0.5697         | 0.4794     | 0.8109     | 0.7288       | 0.7676   | 0.5881    | 0.6301      | 0.6084  | 0.6943        | 0.5900          | 0.6379      | 0.0            | 0.0              | 0.0          |
| 0.7883        | 7.0   | 12292 | 0.8049          | 0.7133   | 0.6065 | 0.5998 | 0.6008 | 0.5998 | 0.6620   | 0.7362     | 0.6971 | 0.6193     | 0.6080       | 0.6136   | 0.4283       | 0.4911         | 0.4576     | 0.6456    | 0.6199      | 0.6325  | 0.8404       | 0.8292         | 0.8348     | 0.6721       | 0.5849         | 0.6255     | 0.5047        | 0.4075          | 0.4509      | 0.7096         | 0.8548           | 0.7754       | 0.4352       | 0.5114         | 0.4702     | 0.7722     | 0.7541       | 0.7630   | 0.6345    | 0.6072      | 0.6206  | 0.7111        | 0.5931          | 0.6468      | 0.25           | 0.2              | 0.2222       |
| 0.7724        | 8.0   | 14048 | 0.7981          | 0.7174   | 0.6296 | 0.5832 | 0.5941 | 0.5832 | 0.6869   | 0.7086     | 0.6976 | 0.6292     | 0.6277       | 0.6284   | 0.5897       | 0.3696         | 0.4544     | 0.6136    | 0.6538      | 0.6331  | 0.8224       | 0.8514         | 0.8367     | 0.6859       | 0.5716         | 0.6235     | 0.5257        | 0.4075          | 0.4591      | 0.7333         | 0.7987           | 0.7646       | 0.4078       | 0.5618         | 0.4725     | 0.7782     | 0.7740       | 0.7761   | 0.6324    | 0.6101      | 0.6211  | 0.7046        | 0.5712          | 0.6309      | 0.375          | 0.075            | 0.1250       |
| 0.7644        | 9.0   | 15804 | 0.7984          | 0.7155   | 0.6223 | 0.5727 | 0.5888 | 0.5727 | 0.6514   | 0.7481     | 0.6964 | 0.6069     | 0.6473       | 0.6265   | 0.5131       | 0.4196         | 0.4617     | 0.6629    | 0.6234      | 0.6426  | 0.8348       | 0.8311         | 0.8329     | 0.6112       | 0.6533         | 0.6316     | 0.5514        | 0.3806          | 0.4504      | 0.7335         | 0.8086           | 0.7692       | 0.4865       | 0.3749         | 0.4235     | 0.8020     | 0.7396       | 0.7695   | 0.6567    | 0.5891      | 0.6211  | 0.7298        | 0.5790          | 0.6457      | 0.25           | 0.05             | 0.0833       |
| 0.7531        | 10.0  | 17560 | 0.7929          | 0.7181   | 0.6020 | 0.5761 | 0.5853 | 0.5761 | 0.6524   | 0.7454     | 0.6958 | 0.6170     | 0.6291       | 0.6230   | 0.5325       | 0.3804         | 0.4437     | 0.6675    | 0.6222      | 0.6441  | 0.8269       | 0.8428         | 0.8348     | 0.6892       | 0.5924         | 0.6372     | 0.5144        | 0.4215          | 0.4634      | 0.6939         | 0.8680           | 0.7713       | 0.4655       | 0.4402         | 0.4525     | 0.7802     | 0.7703       | 0.7753   | 0.6405    | 0.6149      | 0.6274  | 0.7464        | 0.5618          | 0.6411      | 0.0            | 0.0              | 0.0          |
| 0.7462        | 11.0  | 19316 | 0.7868          | 0.7187   | 0.6001 | 0.5776 | 0.5861 | 0.5776 | 0.6634   | 0.7412     | 0.7001 | 0.6197     | 0.6425       | 0.6309   | 0.4802       | 0.4125         | 0.4438     | 0.6403    | 0.6246      | 0.6323  | 0.8266       | 0.8413         | 0.8339     | 0.6714       | 0.6067         | 0.6374     | 0.5649        | 0.3978          | 0.4669      | 0.7096         | 0.8548           | 0.7754       | 0.4643       | 0.4688         | 0.4665     | 0.7973     | 0.7468       | 0.7712   | 0.6703    | 0.5815      | 0.6228  | 0.6930        | 0.5900          | 0.6374      | 0.0            | 0.0              | 0.0          |
| 0.7357        | 12.0  | 21072 | 0.7876          | 0.7175   | 0.6298 | 0.5922 | 0.6045 | 0.5922 | 0.6497   | 0.7540     | 0.6980 | 0.6146     | 0.6435       | 0.6287   | 0.4805       | 0.4393         | 0.4590     | 0.6954    | 0.5953      | 0.6415  | 0.8410       | 0.8250         | 0.8329     | 0.6719       | 0.6124         | 0.6408     | 0.5377        | 0.4215          | 0.4726      | 0.7297         | 0.8284           | 0.7759       | 0.4420       | 0.4896         | 0.4646     | 0.7911     | 0.7740       | 0.7824   | 0.6545    | 0.5996      | 0.6259  | 0.7228        | 0.5915          | 0.6506      | 0.3571         | 0.125            | 0.1852       |
| 0.7242        | 13.0  | 22828 | 0.7810          | 0.7205   | 0.6004 | 0.5846 | 0.5903 | 0.5846 | 0.6679   | 0.7310     | 0.6980 | 0.6422     | 0.6277       | 0.6348   | 0.4782       | 0.4304         | 0.4530     | 0.6712    | 0.6304      | 0.6502  | 0.8237       | 0.8440         | 0.8337     | 0.6598       | 0.6231         | 0.6409     | 0.5565        | 0.4022          | 0.4669      | 0.7213         | 0.8713           | 0.7892       | 0.4847       | 0.4243         | 0.4525     | 0.7698     | 0.7740       | 0.7719   | 0.6276    | 0.6330      | 0.6303  | 0.7022        | 0.6088          | 0.6521      | 0.0            | 0.0              | 0.0          |
| 0.7216        | 14.0  | 24584 | 0.7839          | 0.7200   | 0.6543 | 0.5946 | 0.6044 | 0.5946 | 0.6680   | 0.7423     | 0.7032 | 0.5927     | 0.6814       | 0.6340   | 0.5271       | 0.4            | 0.4548     | 0.7023    | 0.6070      | 0.6512  | 0.8409       | 0.8267         | 0.8337     | 0.6973       | 0.5907         | 0.6396     | 0.5560        | 0.4108          | 0.4725      | 0.7330         | 0.8515           | 0.7878       | 0.4193       | 0.5707         | 0.4835     | 0.7890     | 0.7776       | 0.7832   | 0.6516    | 0.6044      | 0.6271  | 0.7283        | 0.5915          | 0.6528      | 0.6            | 0.075            | 0.1333       |
| 0.7136        | 15.0  | 26340 | 0.7812          | 0.7228   | 0.6390 | 0.5889 | 0.6012 | 0.5889 | 0.6691   | 0.7383     | 0.7020 | 0.6679     | 0.5898       | 0.6265   | 0.5154       | 0.4482         | 0.4795     | 0.6839    | 0.6175      | 0.6490  | 0.8221       | 0.8489         | 0.8353     | 0.6613       | 0.6213         | 0.6407     | 0.5508        | 0.4140          | 0.4727      | 0.7260         | 0.8482           | 0.7823       | 0.4718       | 0.4718         | 0.4718     | 0.7932     | 0.7631       | 0.7779   | 0.6205    | 0.6454      | 0.6327  | 0.7254        | 0.5994          | 0.6564      | 0.4            | 0.05             | 0.0889       |
| 0.7092        | 16.0  | 28096 | 0.7793          | 0.7225   | 0.6047 | 0.5858 | 0.5928 | 0.5858 | 0.6690   | 0.7391     | 0.7023 | 0.6432     | 0.6296       | 0.6363   | 0.5098       | 0.4179         | 0.4593     | 0.6622    | 0.6398      | 0.6508  | 0.8315       | 0.8426         | 0.8370     | 0.6647       | 0.616          | 0.6394     | 0.5688        | 0.4             | 0.4697      | 0.7301         | 0.8482           | 0.7847       | 0.4468       | 0.4896         | 0.4672     | 0.7833     | 0.7649       | 0.7740   | 0.6341    | 0.6177      | 0.6258  | 0.7182        | 0.6103          | 0.6599      | 0.0            | 0.0              | 0.0          |
| 0.7052        | 17.0  | 29852 | 0.7800          | 0.7224   | 0.6070 | 0.5875 | 0.5949 | 0.5875 | 0.6625   | 0.7469     | 0.7021 | 0.6365     | 0.6344       | 0.6355   | 0.5312       | 0.4107         | 0.4632     | 0.6874    | 0.6199      | 0.6519  | 0.8338       | 0.8367         | 0.8353     | 0.6665       | 0.62           | 0.6424     | 0.5529        | 0.4161          | 0.4748      | 0.7270         | 0.8614           | 0.7885       | 0.4559       | 0.4906         | 0.4726     | 0.7996     | 0.7649       | 0.7819   | 0.6444    | 0.6168      | 0.6303  | 0.6935        | 0.6197          | 0.6545      | 0.0            | 0.0              | 0.0          |
| 0.6988        | 18.0  | 31608 | 0.7770          | 0.7233   | 0.6089 | 0.5873 | 0.5950 | 0.5873 | 0.6674   | 0.7446     | 0.7038 | 0.6192     | 0.6483       | 0.6334   | 0.5072       | 0.4393         | 0.4708     | 0.6937    | 0.6199      | 0.6547  | 0.8287       | 0.8427         | 0.8356     | 0.6801       | 0.6084         | 0.6423     | 0.5853        | 0.3946          | 0.4714      | 0.7216         | 0.8812           | 0.7935       | 0.4646       | 0.4738         | 0.4691     | 0.7885     | 0.7685       | 0.7784   | 0.6457    | 0.6063      | 0.6254  | 0.7132        | 0.6072          | 0.6560      | 0.0            | 0.0              | 0.0          |
| 0.7021        | 19.0  | 33364 | 0.7778          | 0.7238   | 0.6356 | 0.5900 | 0.6000 | 0.5900 | 0.6731   | 0.7389     | 0.7045 | 0.6348     | 0.6306       | 0.6327   | 0.5010       | 0.4482         | 0.4731     | 0.6972    | 0.6222      | 0.6576  | 0.8285       | 0.8431         | 0.8358     | 0.6651       | 0.6249         | 0.6444     | 0.5852        | 0.3989          | 0.4744      | 0.7421         | 0.8548           | 0.7945       | 0.4534       | 0.4817         | 0.4671     | 0.7896     | 0.7667       | 0.7780   | 0.6365    | 0.6311      | 0.6338  | 0.7228        | 0.6041          | 0.6581      | 0.3333         | 0.025            | 0.0465       |
| 0.703         | 20.0  | 35120 | 0.7772          | 0.7230   | 0.6333 | 0.5894 | 0.5987 | 0.5894 | 0.6716   | 0.7385     | 0.7035 | 0.6341     | 0.6310       | 0.6326   | 0.5083       | 0.4375         | 0.4702     | 0.6816    | 0.6234      | 0.6512  | 0.8272       | 0.8432         | 0.8351     | 0.6761       | 0.6133         | 0.6432     | 0.5690        | 0.4032          | 0.4720      | 0.7358         | 0.8548           | 0.7908       | 0.4536       | 0.4886         | 0.4705     | 0.7860     | 0.7703       | 0.7781   | 0.6407    | 0.6273      | 0.6339  | 0.7153        | 0.6056          | 0.6559      | 0.3333         | 0.025            | 0.0465       |


### Framework versions

- Transformers 4.32.0.dev0
- Pytorch 2.0.1
- Datasets 2.12.0
- Tokenizers 0.11.0