DistilBERT
Collection
Smaller BERT models for question answering and text classification
•
13 items
•
Updated
Sparse DISTILBERT model (uncased)
Finetuned model pruned to 1:4 structured sparsity.
Intended Use
The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.
Evaluation Results
We get the following results on the SQuADv1.1 tasks development set:
| Task | SQuADv1.1 (F1) |
|---|---|
| 87.00 |
- Downloads last month
- 6