Lin-K76 commited on
Commit
4703726
1 Parent(s): 03ac659

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -24,7 +24,7 @@ language:
24
  - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)
25
  - **Model Developers:** Neural Magic
26
 
27
- Quantized version of [Meta-Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct). It achieves an average recovery of 99.82% on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), compared to the unquantized model.
28
  <!-- It achieves an average score of 78.69 on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), whereas the unquantized model achieves 78.67. -->
29
 
30
  ### Model Optimizations
@@ -167,11 +167,11 @@ Certain benchmarks for the full precision model are still being acquired. Averag
167
  <tr>
168
  <td>ARC Challenge (25-shot)
169
  </td>
170
- <td>73.38
171
  </td>
172
- <td>72.61
173
  </td>
174
- <td>98.95%
175
  </td>
176
  </tr>
177
  <tr>
@@ -219,9 +219,9 @@ Certain benchmarks for the full precision model are still being acquired. Averag
219
  </td>
220
  <td><strong>*</strong>
221
  </td>
222
- <td><strong>82.38</strong>
223
  </td>
224
- <td><strong>99.82%</strong>
225
  </td>
226
  </tr>
227
  </table>
 
24
  - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)
25
  - **Model Developers:** Neural Magic
26
 
27
+ Quantized version of [Meta-Llama-3.1-405B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct). It achieves an average recovery of 100.1% on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), compared to the unquantized model.
28
  <!-- It achieves an average score of 78.69 on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) benchmark (version 1), whereas the unquantized model achieves 78.67. -->
29
 
30
  ### Model Optimizations
 
167
  <tr>
168
  <td>ARC Challenge (25-shot)
169
  </td>
170
+ <td>*
171
  </td>
172
+ <td>*
173
  </td>
174
+ <td>*
175
  </td>
176
  </tr>
177
  <tr>
 
219
  </td>
220
  <td><strong>*</strong>
221
  </td>
222
+ <td><strong>*</strong>
223
  </td>
224
+ <td><strong>100.1%</strong>
225
  </td>
226
  </tr>
227
  </table>