DistilBERT-Banking77
trained using autoNLP
- Problem type: Multi-class Classification
Validation Metrics
- Loss: 0.2988220155239105
- Accuracy: 0.9246753246753247
- Macro F1: 0.9246117406953515
- Micro F1: 0.9246753246753247
- Weighted F1: 0.9246117406953518
- Macro Precision: 0.9278163684429038
- Micro Precision: 0.9246753246753247
- Weighted Precision: 0.927816368442904
- Macro Recall: 0.9246753246753248
- Micro Recall: 0.9246753246753247
- Weighted Recall: 0.9246753246753247
Usage
You can use cURL to access this model:
$ curl -X POST -H "Authorization: Bearer YOUR_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "What is the base of the exchange rates?"}' https://api-inference.huggingface.co/models/philschmid/DistilBERT
Or Python API:
from transformers import AutoTokenizer, AutoModelForSequenceClassification, pipeline
model_id = 'philschmid/DistilBERT-Banking77'
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)
classifier = pipeline('text-classification', tokenizer=tokenizer, model=model)
classifier('What is the base of the exchange rates?')
- Downloads last month
- 11
Dataset used to train philschmid/DistilBERT-Banking77
Evaluation results
- Accuracy on BANKING77self-reported92.470
- Macro F1 on BANKING77self-reported92.460
- Weighted F1 on BANKING77self-reported92.460