File size: 621 Bytes
d62a5ce 4d03cd5 7962e92 3d4f84e 4d03cd5 7962e92 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
license: mit
---
# Sparse BERT mini model (uncased)
Finetuned model pruned to 1:4 structured sparsity.
The model is a pruned version of the [BERT mini model](https://huggingface.co/prajjwal1/bert-mini).
## Intended Use
The model can be used for inference with sparsity optimization.
For further details on the model and its usage will be soon available.
## Evaluation Results
We get the following results on the sst2 tasks development set:
| Task | SST-2 (Acc) |
|------|-------------|
| | 87.2 |
Better than dense [bert mini](https://huggingface.co/M-FAC/bert-mini-finetuned-sst2) which is 84.74%.
|