Commit
•
63759c9
1
Parent(s):
fa4493a
Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,7 @@ base_model:
|
|
| 3 |
- TouchNight/Ministral-8B-Instruct-2410-HF
|
| 4 |
---
|
| 5 |
It is worth noting that compared with the prince-canuma version, this version is smaller in size after quantization and its accuracy is also improved by one percentage point.
|
|
|
|
| 6 |
In my ERP testing, this model did perform better.
|
| 7 |
|
| 8 |
vllm (pretrained=/root/autodl-tmp/Ministral-8B-Instruct-2410-HF,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=float16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
|
|
|
|
| 3 |
- TouchNight/Ministral-8B-Instruct-2410-HF
|
| 4 |
---
|
| 5 |
It is worth noting that compared with the prince-canuma version, this version is smaller in size after quantization and its accuracy is also improved by one percentage point.
|
| 6 |
+
|
| 7 |
In my ERP testing, this model did perform better.
|
| 8 |
|
| 9 |
vllm (pretrained=/root/autodl-tmp/Ministral-8B-Instruct-2410-HF,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=float16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
|