vuiseng9 commited on
Commit
8371e81
1 Parent(s): f411bdb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  * A set of unstructured sparse bert-base-uncased models fine-tuned for SQuADv1.
2
  * Tensorflow models are created using ```TFAutoModelForQuestionAnswering.from_pretrained(..., from_pt=True)``` and ```model.save_pretrained(tf_pth)```.
3
  * Observed issue - loss in model translation, discrepancy observed in evaluation between pytorch and tensorflow models.
4
- * Table below is evaluated in HF's transformers v4.9.2.
5
  * Evaluation cli:
6
  ```bash
7
  python run_qa.py \
1
  * A set of unstructured sparse bert-base-uncased models fine-tuned for SQuADv1.
2
  * Tensorflow models are created using ```TFAutoModelForQuestionAnswering.from_pretrained(..., from_pt=True)``` and ```model.save_pretrained(tf_pth)```.
3
  * Observed issue - loss in model translation, discrepancy observed in evaluation between pytorch and tensorflow models.
4
+ * Table below is evaluated in HF's transformers v4.9.2. Sparsity is normalized to dense layers in attention heads and FFNN.
5
  * Evaluation cli:
6
  ```bash
7
  python run_qa.py \