DistilBERT
Collection
Smaller BERT models for question answering and text classification
•
13 items
•
Updated
Sparse DISTILBERT model (uncased)
Finetuned model pruned to 1:4 structured sparsity.
Intended Use
The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.
Evaluation Results
We get the following results on the SQuADv1.1 tasks development set:
| Task | SQuADv1.1 (F1) |
|---|---|
| 87.00 |
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.