---
license: apache-2.0
---

# Sparse DISTILBERT model (uncased)

Finetuned model pruned to 1:4 structured sparsity.

## Intended Use

The model can be used for inference with sparsity optimization.
For further details on the model and its usage will be soon available.

## Evaluation Results
We get the following results on the SQuADv1.1 tasks development set:

| Task | SQuADv1.1 (F1) |
|------|----------------|
|      |      87.00     |