Adding AWQ quants (#5)
Browse files- Adding AWQ quants (ef38071da379882c5231b28c7100a42fac25199b)
Co-authored-by: Shaun Prince <Suparious@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -365,6 +365,10 @@ model.generate(**gen_input)
|
|
| 365 |
|
| 366 |
- https://huggingface.co/bartowski/Einstein-v6-7B-exl2
|
| 367 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 368 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 369 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Einstein-v6-7B)
|
| 370 |
|
|
|
|
| 365 |
|
| 366 |
- https://huggingface.co/bartowski/Einstein-v6-7B-exl2
|
| 367 |
|
| 368 |
+
## AWQ [@solidrust](https://huggingface.co/solidrust)
|
| 369 |
+
|
| 370 |
+
- https://huggingface.co/solidrust/Einstein-v6-7B-AWQ
|
| 371 |
+
|
| 372 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 373 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Einstein-v6-7B)
|
| 374 |
|