Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
* A set of unstructured sparse bert-base-uncased models fine-tuned for SQuADv1.
|
2 |
* Tensorflow models are created using ```TFAutoModelForQuestionAnswering.from_pretrained(..., from_pt=True)``` and ```model.save_pretrained(tf_pth)```.
|
3 |
* Observed issue - loss in model translation, discrepancy observed in evaluation between pytorch and tensorflow models.
|
4 |
-
* Table below is evaluated in HF's transformers v4.9.2.
|
5 |
* Evaluation cli:
|
6 |
```bash
|
7 |
python run_qa.py \
|
|
|
1 |
* A set of unstructured sparse bert-base-uncased models fine-tuned for SQuADv1.
|
2 |
* Tensorflow models are created using ```TFAutoModelForQuestionAnswering.from_pretrained(..., from_pt=True)``` and ```model.save_pretrained(tf_pth)```.
|
3 |
* Observed issue - loss in model translation, discrepancy observed in evaluation between pytorch and tensorflow models.
|
4 |
+
* Table below is evaluated in HF's transformers v4.9.2. Sparsity is normalized to dense layers in attention heads and FFNN.
|
5 |
* Evaluation cli:
|
6 |
```bash
|
7 |
python run_qa.py \
|