### BERT-base compressed by JPQD with Regularization Factor 0.03 ``` F1: 87.66 EM: 80.23 ``` ### Description of important files ``` ├── r0.030-squad-bert-b-mvmt-8bit │   ├── 8bit_ref_bert_squad_nncf_mvmt.json (nncf config used with ssbs-feb branch) │   ├── checkpoint-110000 (trained checkpoint for generation) │   ├── ir │   │   ├── sparsity_structures.csv │   │   ├── sparsity_structures.md (layer wise sparsity reporting, for linear layer in transformer block only) │   │   ├── sparsity_structures.pkl (containing pruned structure id, e.g. particular head in MHSA or dimension in FFN, useful for debug) │   │   └── squad-BertForQuestionAnswering.cropped.8bit.xml (custom discard of pruned dimension and onnx export, followed by ir translation │   ├── ir_uncropped │   │   ├── mo-pruned-ir │   │   │   ├── mo.log (see Model Optimizer version here) │   │   │   └── squad-BertForQuestionAnswering.8bit.xml (pruned structures are removed using Model Optimier --transform=Pruning) │   │   └── squad-BertForQuestionAnswering.8bit.xml (pruned structures are sparsified/zero-ed only) ```