This is a model checkpoint for "Structured Pruning Learns Compact and Accurate Models". The model is pruned from bert-base-uncased to a 60% sparsity on dataset SQuAD 1.1. Please go to our repository for more details on how to use the model for inference. Note that you would have to use the model class specified in our repository to load the model.