| license: apache-2.0 | |
| # Sparse DISTILBERT model (uncased) | |
| Finetuned model pruned to 1:4 structured sparsity. | |
| ## Intended Use | |
| The model can be used for inference with sparsity optimization. | |
| For further details on the model and its usage will be soon available. | |
| ## Evaluation Results | |
| We get the following results on the SQuADv1.1 tasks development set: | |
| | Task | SQuADv1.1 (F1) | | |
| |------|----------------| | |
| | | 87.00 | | |