Mental-BERT + BiLSTM

Multi-label emotion classifier trained on depression-related text.

  • Base model: mental/mental-bert-base-uncased
  • Architecture: Custom encoder + BiLSTM + linear head
  • Labels (8): anger, brain dysfunction (forget), emptiness, hopelessness, loneliness, sadness, suicide intent, worthlessness
  • Seed: 42, Epochs: 5, LR: 2e-05, MaxLen: 256

Test metrics

{
  "eval_loss": 0.7537274360656738,
  "eval_P-Mic": 0.8258887876025525,
  "eval_R-Mic": 0.8125560538116592,
  "eval_F1-Mic": 0.8191681735985533,
  "eval_P-Mac": 0.8063522199030424,
  "eval_R-Mac": 0.7400092937153445,
  "eval_F1-Mac": 0.7469127047704985
}
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support