yujiepan commited on
Commit
1b513b7
1 Parent(s): 636c8c4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ datasets:
5
+ - squad
6
+ model-index:
7
+ - name: test.mobilebert-uncased-squadv1
8
+ results:
9
+ - task:
10
+ name: Question Answering
11
+ type: question-answering
12
+ dataset:
13
+ name: Squadv1
14
+ type: squadv1
15
+ split: validation
16
+ metrics:
17
+ - name: F1
18
+ type: f1
19
+ value: 90.9013
20
+ - name: EM
21
+ type: exact_match
22
+ value: 83.9735
23
+ ---
24
+
25
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
26
+ should probably proofread and complete it, then remove this comment. -->
27
+
28
+ # test.mobilebert-uncased-squadv1
29
+
30
+ This model takes the same weights as [neuralmagic/mobilebert-uncased-finetuned-squadv1](https://huggingface.co/neuralmagic/mobilebert-uncased-finetuned-squadv1) but is converted to OpenVINO IR format.
31
+
32
+ Eval results: (pad_to_max_length=True, max_length=384)
33
+ - eval_exact_match: 83.9735
34
+ - eval_f1: 90.9013
35
+
36
+
37
+
38
+ ### Framework versions
39
+
40
+ - Transformers 4.26.0
41
+ - Pytorch 1.13.1+cu116
42
+ - Datasets 2.8.0
43
+ - Tokenizers 0.13.2
44
+ - Optimum-intel 1.7.0
45
+ - NNCF 2.4.0