Update README.md
Browse files
README.md
CHANGED
|
@@ -41,6 +41,15 @@ It is one of the very best 7B models in terms of instructing following and reaso
|
|
| 41 |
## ⚡ Quantized models
|
| 42 |
|
| 43 |
* **GGUF**: https://huggingface.co/mlabonne/AlphaMonarch-7B-GGUF
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
|
| 45 |
## 🏆 Evaluation
|
| 46 |
|
|
|
|
| 41 |
## ⚡ Quantized models
|
| 42 |
|
| 43 |
* **GGUF**: https://huggingface.co/mlabonne/AlphaMonarch-7B-GGUF
|
| 44 |
+
* **GPTQ**: https://huggingface.co/LoneStriker/AlphaMonarch-7B-GPTQ
|
| 45 |
+
* **AWQ**: https://huggingface.co/LoneStriker/AlphaMonarch-7B-AWQ
|
| 46 |
+
* **mlx**: https://huggingface.co/mlx-community/AlphaMonarch-7B-mlx
|
| 47 |
+
* **EXL2**:
|
| 48 |
+
* https://huggingface.co/LoneStriker/AlphaMonarch-7B-3.0bpw-h6-exl2
|
| 49 |
+
* https://huggingface.co/LoneStriker/AlphaMonarch-7B-4.0bpw-h6-exl2
|
| 50 |
+
* https://huggingface.co/LoneStriker/AlphaMonarch-7B-5.0bpw-h6-exl2
|
| 51 |
+
* https://huggingface.co/LoneStriker/AlphaMonarch-7B-6.0bpw-h6-exl2
|
| 52 |
+
* https://huggingface.co/LoneStriker/AlphaMonarch-7B-8.0bpw-h6-exl2
|
| 53 |
|
| 54 |
## 🏆 Evaluation
|
| 55 |
|