Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
```python
|
2 |
from typing import List
|
3 |
|
|
|
1 |
+
```
|
2 |
+
vllm (pretrained=/home/mgoin/code/llm-compressor/examples/quantizing_moe/Mixtral-8x7B-Instruct-v0.1-FP8,tensor_parallel_size=2), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
|
3 |
+
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|
4 |
+
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|
5 |
+
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.6338|± |0.0133|
|
6 |
+
| | |strict-match | 5|exact_match|↑ |0.6293|± |0.0133|
|
7 |
+
```
|
8 |
+
|
9 |
+
## Creation
|
10 |
+
|
11 |
```python
|
12 |
from typing import List
|
13 |
|