Edit model card

Sparse BERT mini model (uncased)

Finetuned model pruned to 1:4 structured sparsity. The model is a pruned version of the BERT mini model.

Intended Use

The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.

Evaluation Results

We get the following results on the sst2 tasks development set:

Task SST-2 (Acc)
Better than dense bert mini which is 84.74%.
Downloads last month
Hosted inference API
Text Classification
This model can be loaded on the Inference API on-demand.