File size: 621 Bytes
eaf79dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5db3fc0
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
language: en
tags:
- go-emotion
- text-classification
- pytorch
datasets:
- go_emotions
metrics:
- f1
widget:
- text: "Thanks for giving advice to the people who need it! πŸ‘ŒπŸ™"
license: mit
---

## Model Description
1. Based on the uncased BERT pretrained model with a linear output layer.
2. Added several commonly-used emoji and tokens to the special token list of the tokenizer.
3. Did label smoothing while training.
4. Used weighted loss and focal loss to help the cases which trained badly.

## Results
Best Result of `Macro F1` - 70%

## Tutorial Link
- [GitHub](https://github.com/justin871030/GoEmotions)