sjrhuschlee commited on
Commit
f3eda55
1 Parent(s): b315c71

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -72,6 +72,33 @@ answer = tokenizer.decode(tokenizer.convert_tokens_to_ids(answer_tokens))
72
  # 'London'
73
  ```
74
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  ### Using with Peft
76
  **NOTE**: This requires code in the PR https://github.com/huggingface/peft/pull/473 for the PEFT library.
77
  ```python
 
72
  # 'London'
73
  ```
74
 
75
+ ## Metrics
76
+
77
+ ```bash
78
+ # Squad v2
79
+ {
80
+ "eval_HasAns_exact": 85.08771929824562,
81
+ "eval_HasAns_f1": 90.598422845031,
82
+ "eval_HasAns_total": 5928,
83
+ "eval_NoAns_exact": 88.47771236333053,
84
+ "eval_NoAns_f1": 88.47771236333053,
85
+ "eval_NoAns_total": 5945,
86
+ "eval_best_exact": 86.78514276088605,
87
+ "eval_best_exact_thresh": 0.0,
88
+ "eval_best_f1": 89.53654936623764,
89
+ "eval_best_f1_thresh": 0.0,
90
+ "eval_exact": 86.78514276088605,
91
+ "eval_f1": 89.53654936623776,
92
+ "eval_runtime": 1908.3189,
93
+ "eval_samples": 12001,
94
+ "eval_samples_per_second": 6.289,
95
+ "eval_steps_per_second": 0.787,
96
+ "eval_total": 11873
97
+ }
98
+
99
+ # Squad
100
+ ```
101
+
102
  ### Using with Peft
103
  **NOTE**: This requires code in the PR https://github.com/huggingface/peft/pull/473 for the PEFT library.
104
  ```python