|
--- |
|
license: apache-2.0 |
|
tags: |
|
- generated_from_trainer |
|
datasets: |
|
- AdamCodd/emotion-balanced |
|
metrics: |
|
- accuracy |
|
- f1 |
|
- recall |
|
- precision |
|
base_model: distilbert-base-uncased |
|
model-index: |
|
- name: distilbert-base-uncased-finetuned-emotion-balanced |
|
results: |
|
- task: |
|
type: text-classification |
|
name: Text Classification |
|
dataset: |
|
name: emotion |
|
type: emotion |
|
args: default |
|
metrics: |
|
- type: accuracy |
|
value: 0.9521 |
|
name: Accuracy |
|
- type: loss |
|
value: 0.1216 |
|
name: Loss |
|
- type: f1 |
|
value: 0.9520944952964783 |
|
name: F1 |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# distilbert-emotion |
|
|
|
<u><b>Reupload [10/02/23]</b></u> : The model has been retrained using identical hyperparameters, but this time on an even more pristine dataset, free of certain scraping artifacts. Remarkably, it maintains the same level of accuracy and loss while demonstrating superior generalization capabilities. |
|
|
|
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the [emotion balanced dataset](https://huggingface.co/datasets/AdamCodd/emotion-balanced). |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.1216 |
|
- Accuracy: 0.9521 |
|
|
|
<b>ONNX version</b>: [distilbert-base-uncased-finetuned-emotion-balanced-onnx](https://huggingface.co/AdamCodd/distilbert-base-uncased-finetuned-emotion-balanced-onnx) |
|
|
|
## Model description |
|
|
|
This emotion classifier has been trained on 89_754 examples split into train, validation and test. Each label was perfectly balanced in each split. |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 3e-05 |
|
- train_batch_size: 32 |
|
- eval_batch_size: 64 |
|
- seed: 1270 |
|
- optimizer: AdamW with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 150 |
|
- num_epochs: 3 |
|
- weight_decay: 0.01 |
|
|
|
### Training results |
|
|
|
precision recall f1-score support |
|
|
|
sadness 0.9882 0.9485 0.9679 1496 |
|
joy 0.9956 0.9057 0.9485 1496 |
|
love 0.9256 0.9980 0.9604 1496 |
|
anger 0.9628 0.9519 0.9573 1496 |
|
fear 0.9348 0.9098 0.9221 1496 |
|
surprise 0.9160 0.9987 0.9555 1496 |
|
|
|
accuracy 0.9521 8976 |
|
macro avg 0.9538 0.9521 0.9520 8976 |
|
weighted avg 0.9538 0.9521 0.9520 8976 |
|
|
|
test_acc: 0.9520944952964783 |
|
test_loss: 0.121663898229599 |
|
|
|
### Framework versions |
|
|
|
- Transformers 4.33.1 |
|
- Pytorch lightning 2.0.8 |
|
- Tokenizers 0.13.3 |
