|
--- |
|
license: mit |
|
datasets: |
|
- SkyWater21/lv_go_emotions |
|
language: |
|
- lv |
|
--- |
|
|
|
Fine-tuned [LVBERT](https://huggingface.co/AiLab-IMCS-UL/lvbert) for multi-label emotion classification task. |
|
|
|
Model was trained on [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) dataset. This dataset is Latvian translation of [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset. Google Translate was used to generate the machine translation. |
|
|
|
Labels: |
|
```yaml |
|
0: admiration |
|
1: amusement |
|
2: anger |
|
3: annoyance |
|
4: approval |
|
5: caring |
|
6: confusion |
|
7: curiosity |
|
8: desire |
|
9: disappointment |
|
10: disapproval |
|
11: disgust |
|
12: embarrassment |
|
13: excitement |
|
14: fear |
|
15: gratitude |
|
16: grief |
|
17: joy |
|
18: love |
|
19: nervousness |
|
20: optimism |
|
21: pride |
|
22: realization |
|
23: relief |
|
24: remorse |
|
25: sadness |
|
26: surprise |
|
27: neutral |
|
``` |
|
|
|
Seed used for random number generator is 42: |
|
```python |
|
def set_seed(seed=42): |
|
random.seed(seed) |
|
np.random.seed(seed) |
|
torch.manual_seed(seed) |
|
if torch.cuda.is_available(): |
|
torch.cuda.manual_seed_all(seed) |
|
``` |
|
|
|
Training parameters: |
|
```yaml |
|
max_length: null |
|
batch_size: 32 |
|
shuffle: True |
|
num_workers: 2 |
|
pin_memory: False |
|
drop_last: False |
|
|
|
optimizer: adam |
|
lr: 0.00001 |
|
weight_decay: 0 |
|
|
|
problem_type: multi_label_classification |
|
|
|
num_epochs: 5 |
|
``` |
|
|
|
Evaluation results on test split of [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) |
|
| |Precision|Recall|F1-Score|AUC-ROC|Support| |
|
|--------------|---------|------|--------|-------|-------| |
|
|admiration | 0.64| 0.64| 0.64| 0.92| 504| |
|
|amusement | 0.76| 0.85| 0.80| 0.96| 264| |
|
|anger | 0.51| 0.21| 0.29| 0.86| 198| |
|
|annoyance | 0.49| 0.15| 0.23| 0.78| 320| |
|
|approval | 0.35| 0.33| 0.34| 0.80| 351| |
|
|caring | 0.43| 0.39| 0.41| 0.89| 135| |
|
|confusion | 0.53| 0.33| 0.41| 0.94| 153| |
|
|curiosity | 0.49| 0.42| 0.45| 0.94| 284| |
|
|desire | 0.63| 0.37| 0.47| 0.92| 83| |
|
|disappointment| 0.45| 0.11| 0.18| 0.82| 151| |
|
|disapproval | 0.45| 0.25| 0.32| 0.84| 267| |
|
|disgust | 0.63| 0.29| 0.40| 0.92| 123| |
|
|embarrassment | 0.50| 0.14| 0.21| 0.85| 37| |
|
|excitement | 0.55| 0.16| 0.24| 0.89| 103| |
|
|fear | 0.65| 0.58| 0.61| 0.95| 78| |
|
|gratitude | 0.88| 0.91| 0.90| 0.99| 352| |
|
|grief | 0.00| 0.00| 0.00| 0.78| 6| |
|
|joy | 0.61| 0.39| 0.47| 0.93| 161| |
|
|love | 0.80| 0.69| 0.74| 0.97| 238| |
|
|nervousness | 0.00| 0.00| 0.00| 0.95| 23| |
|
|optimism | 0.57| 0.47| 0.52| 0.90| 186| |
|
|pride | 0.00| 0.00| 0.00| 0.73| 16| |
|
|realization | 0.29| 0.08| 0.13| 0.76| 145| |
|
|relief | 0.00| 0.00| 0.00| 0.85| 11| |
|
|remorse | 0.54| 0.68| 0.60| 0.98| 56| |
|
|sadness | 0.60| 0.50| 0.54| 0.93| 156| |
|
|surprise | 0.65| 0.41| 0.50| 0.92| 141| |
|
|neutral | 0.67| 0.50| 0.57| 0.81| 1787| |
|
|micro avg | 0.62| 0.46| 0.53| 0.93| 6329| |
|
|macro avg | 0.49| 0.35| 0.39| 0.88| 6329| |
|
|weighted avg | 0.60| 0.46| 0.51| 0.87| 6329| |
|
|samples avg | 0.52| 0.48| 0.49| nan| 6329| |
