This is a model checkpoint for "Structured Pruning Learns Compact and Accurate Models". The model is pruned from bert-base-uncased to a 60% sparsity on dataset SQuAD 1.1. Please go to our repository for more details on how to use the model for inference.