Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,14 @@ tags:
|
|
| 11 |
- merge
|
| 12 |
license: cc-by-nc-4.0
|
| 13 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
# BagelMIsteryTour-v2-8x7B
|
| 15 |
|
| 16 |
[GGUF versions here](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B-GGUF)
|
|
|
|
| 11 |
- merge
|
| 12 |
license: cc-by-nc-4.0
|
| 13 |
---
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
4.5bpw/h6 exl2 quantization of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B) using default exllamav2 calibration dataset, to fully use my 31gb VRAM (-1 cuz windows..).
|
| 17 |
+
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
**ORIGINAL CARD:**
|
| 21 |
+
|
| 22 |
# BagelMIsteryTour-v2-8x7B
|
| 23 |
|
| 24 |
[GGUF versions here](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B-GGUF)
|