DistilBERT fine-tuned on the Emotion dataset

本模型在 emotion 数据集上对 distilbert-base-uncased 进行了微调,用于英文文本的六类情感分类: sadness, joy, love, anger, fear, surprise

评测结果

指标 测试集 验证集
accuracy 0.921 0.944
weighted-F1 0.922 0.944
macro-F1 0.874 0.921

测试集(test split,未参与训练/调参)各类别 F1:sadness 0.961 / joy 0.944 / anger 0.923 / love 0.832 / fear 0.872 / surprise 0.709。其中最稀有的 surprise(仅 66 条)表现最弱。

训练设置

  • base model: distilbert-base-uncased
  • learning rate: 5e-5(由学习率扫描确定,1e-3 会发散、2e-5 略低)
  • epochs: 2,batch size: 64,weight decay: 0.01
  • seed: 42(结果可复现)

用法

from transformers import pipeline

clf = pipeline("text-classification",
               model="Mickey-yy/my-emotion-model")
clf("I love this so much!")
# [{'label': 'joy', 'score': 0.99...}]

局限性

模型主要依赖表层情感词汇,对反讽、否定、混合情感及表情符号/网络口语等分布外输入鲁棒性有限 (例如 “I do not feel happy” 可能仍被判为 joy)。在稀有类别(love/surprise)上的表现也相对较弱。

Downloads last month
1
Safetensors
Model size
67M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Mickey-yy/my-emotion-model

Finetuned
(11992)
this model

Dataset used to train Mickey-yy/my-emotion-model

Evaluation results