--- license: mit datasets: - SkyWater21/lv_go_emotions language: - lv base_model: - AiLab-IMCS-UL/lvbert --- Fine-tuned [LVBERT](https://huggingface.co/AiLab-IMCS-UL/lvbert) for multi-label emotion classification task. Model was trained on [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) dataset. This dataset is Latvian translation of [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset. Google Translate was used to generate the machine translation. Original 26 emotions were mapped to 6 base emotions as per Dr. Ekman theory. Labels predicted by classifier: ```yaml 0: anger 1: disgust 2: fear 3: joy 4: sadness 5: surprise 6: neutral ``` Label mapping from 27 emotions from GoEmotion to 6 base emotions as per Dr. Ekman theory: |GoEmotion|Ekman| |---|---| | admiration | joy| | amusement | joy| | anger | anger| | annoyance | anger| | approval | joy| | caring | joy| | confusion | surprise| | curiosity | surprise| | desire | joy| | disappointment | sadness| | disapproval | anger| | disgust | disgust| | embarrassment | sadness| | excitement | joy| | fear | fear| | gratitude | joy| | grief | sadness| | joy | joy| | love | joy| | nervousness | fear| | optimism | joy| | pride | joy| | realization | surprise| | relief | joy| | remorse | sadness| | sadness | sadness| | surprise | surprise| | neutral | neutral| Seed used for random number generator is 42: ```python def set_seed(seed=42): random.seed(seed) np.random.seed(seed) torch.manual_seed(seed) if torch.cuda.is_available(): torch.cuda.manual_seed_all(seed) ``` Training parameters: ```yaml max_length: null batch_size: 32 shuffle: True num_workers: 2 pin_memory: False drop_last: False optimizer: adam lr: 0.000005 weight_decay: 0 problem_type: multi_label_classification num_epochs: 3 ``` Evaluation results on test split of [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions/viewer/simplified_ekman) | |Precision|Recall|F1-Score|Support| |--------------|---------|------|--------|-------| |anger | 0.57| 0.41| 0.47| 726| |disgust | 0.70| 0.26| 0.38| 123| |fear | 0.66| 0.55| 0.60| 98| |joy | 0.82| 0.79| 0.80| 2104| |sadness | 0.72| 0.46| 0.56| 379| |surprise | 0.63| 0.49| 0.55| 677| |neutral | 0.66| 0.61| 0.63| 1787| |micro avg | 0.72| 0.61| 0.66| 5894| |macro avg | 0.68| 0.51| 0.57| 5894| |weighted avg | 0.71| 0.61| 0.65| 5894| |samples avg | 0.65| 0.63| 0.63| 5894|