- Based on the uncased BERT pretrained model with a linear output layer.
- Added several commonly-used emoji and tokens to the special token list of the tokenizer.
- Did label smoothing while training.
- Used weighted loss and focal loss to help the cases which trained badly.
Best Result of
Macro F1 - 70%
- Downloads last month
This model can be loaded on the Inference API on-demand.