mgoin commited on
Commit
f2c6f8e
1 Parent(s): 955b6a1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -1,3 +1,13 @@
 
 
 
 
 
 
 
 
 
 
1
  ```python
2
  from typing import List
3
 
 
1
+ ```
2
+ vllm (pretrained=/home/mgoin/code/llm-compressor/examples/quantizing_moe/Mixtral-8x7B-Instruct-v0.1-FP8,tensor_parallel_size=2), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
3
+ |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
4
+ |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
5
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.6338|± |0.0133|
6
+ | | |strict-match | 5|exact_match|↑ |0.6293|± |0.0133|
7
+ ```
8
+
9
+ ## Creation
10
+
11
  ```python
12
  from typing import List
13