Edit model card

Sparse DISTILBERT model (uncased)

Finetuned model pruned to 1:4 structured sparsity.

Intended Use

The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.

Evaluation Results

We get the following results on the SQuADv1.1 tasks development set:

Task SQuADv1.1 (F1)
87.00
Downloads last month
3
Hosted inference API
Question Answering
Examples
Examples
This model can be loaded on the Inference API on-demand.