mgoin commited on
Commit
28b8603
1 Parent(s): d288bbc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -17,14 +17,14 @@ Produced using [AutoFP8 with calibration samples from ultrachat](https://github.
17
  ### Open LLM Leaderboard evaluation scores
18
  | | Mixtral-8x7B-Instruct-v0.1 | Mixtral-8x7B-Instruct-v0.1-FP8<br>(this model) |
19
  | :------------------: | :----------------------: | :------------------------------------------------: |
20
- | arc-c<br>25-shot | 71.50 | 70.05 |
21
- | hellaswag<br>10-shot | 87.53 | 86.30 |
22
  | mmlu<br>5-shot | 70.33 | 68.81 |
23
- | truthfulqa<br>0-shot | 64.79 | 63.69 |
24
- | winogrande<br>5-shot | 82.40 | 81.69 |
25
- | gsm8k<br>5-shot | 64.36 | 59.82 |
26
- | **Average<br>Accuracy** | **73.48** | **71.72** |
27
- | **Recovery** | **100%** | **97.60%** |
28
 
29
 
30
 
 
17
  ### Open LLM Leaderboard evaluation scores
18
  | | Mixtral-8x7B-Instruct-v0.1 | Mixtral-8x7B-Instruct-v0.1-FP8<br>(this model) |
19
  | :------------------: | :----------------------: | :------------------------------------------------: |
20
+ | arc-c<br>25-shot | 71.50 | 71.08 |
21
+ | hellaswag<br>10-shot | 87.53 | 87.38 |
22
  | mmlu<br>5-shot | 70.33 | 68.81 |
23
+ | truthfulqa<br>0-shot | 64.79 | 64.20 |
24
+ | winogrande<br>5-shot | 82.40 | 82.40 |
25
+ | gsm8k<br>5-shot | 64.36 | 64.06 |
26
+ | **Average<br>Accuracy** | **73.48** | **72.99** |
27
+ | **Recovery** | **100%** | **99.33%** |
28
 
29
 
30