Mental-BERT

Multi-label emotion classifier trained on depression-related text.

  • Base model: mental/mental-bert-base-uncased
  • Architecture: Standard AutoModelForSequenceClassification
  • Labels (8): anger, brain dysfunction (forget), emptiness, hopelessness, loneliness, sadness, suicide intent, worthlessness
  • Seed: 42, Epochs: 5, LR: 2e-05, MaxLen: 256

Test metrics

{
  "eval_loss": 0.7333596348762512,
  "eval_P-Mic": 0.8343140291111799,
  "eval_R-Mic": 0.8053811659192825,
  "eval_F1-Mic": 0.8195923334347429,
  "eval_P-Mac": 0.807471674923893,
  "eval_R-Mac": 0.7395350139624512,
  "eval_F1-Mac": 0.7559934890149667
}
Downloads last month
99
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support