ofirzaf commited on
Commit
f43011e
1 Parent(s): bea2f00

Add README

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ ---
4
+
5
+ # Sparse BERT base model fine tuned to MNLI (uncased)
6
+
7
+ Fine tuned sparse BERT base to MNLI (GLUE Benchmark) task from [bert-base-uncased-sparse-70-unstructured](https://huggingface.co/Intel/bert-base-uncased-sparse-70-unstructured).
8
+ <br><br>
9
+ Note: This model requires `transformers==2.10.0`
10
+
11
+ ## Evaluation Results
12
+ Matched: 82.5%
13
+ Mismatched: 83.3%
14
+
15
+ This model can be further fine-tuned to other tasks and achieve the following evaluation results:
16
+
17
+ | Task | QQP (Acc/F1) | QNLI (Acc) | SST-2 (Acc) | STS-B (Pears/Spear) | SQuADv1.1 (Acc/F1) |
18
+ |------|--------------|------------|-------------|---------------------|--------------------|
19
+ | | 90.2/86.7 | 90.3 | 91.5 | 88.9/88.6 | 80.5/88.2 |