| license: mit | |
| # Sparse BERT mini model (uncased) | |
| Finetuned model pruned to 1:4 structured sparsity. | |
| The model is a pruned version of the [BERT mini model](https://huggingface.co/prajjwal1/bert-mini). | |
| ## Intended Use | |
| The model can be used for inference with sparsity optimisztion. | |
| For further details on the model and its usage will be soon available. | |
| ## Evaluation Results | |
| We get the following results on the sst2 tasks development set: | |
| | Task | SST-2 (Acc) | | |
| |------|-------------| | |
| | | 87.2 | | |