Instructions to use mahir2021/mental-bert-bilstm-depEMO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mahir2021/mental-bert-bilstm-depEMO with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mahir2021/mental-bert-bilstm-depEMO", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Mental-BERT + BiLSTM
Multi-label emotion classifier trained on depression-related text.
- Base model:
mental/mental-bert-base-uncased - Architecture: Custom encoder + BiLSTM + linear head
- Labels (8): anger, brain dysfunction (forget), emptiness, hopelessness, loneliness, sadness, suicide intent, worthlessness
- Seed: 42, Epochs: 5, LR: 2e-05, MaxLen: 256
Test metrics
{
"eval_loss": 0.7537274360656738,
"eval_P-Mic": 0.8258887876025525,
"eval_R-Mic": 0.8125560538116592,
"eval_F1-Mic": 0.8191681735985533,
"eval_P-Mac": 0.8063522199030424,
"eval_R-Mac": 0.7400092937153445,
"eval_F1-Mac": 0.7469127047704985
}
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support