Add quants
#4
by
bartowski
- opened
README.md
CHANGED
|
@@ -37,7 +37,9 @@ The Locutusque/Hyperion-3.0-Yi-34B model was fine-tuned on 150,000 examples of t
|
|
| 37 |
|
| 38 |
## Quants
|
| 39 |
|
| 40 |
-
|
|
|
|
|
|
|
| 41 |
|
| 42 |
## Evaluation Results
|
| 43 |
Coming soon
|
|
|
|
| 37 |
|
| 38 |
## Quants
|
| 39 |
|
| 40 |
+
ExLlamaV2: https://huggingface.co/bartowski/Hyperion-3.0-Yi-34B-exl2
|
| 41 |
+
|
| 42 |
+
GGUF: https://huggingface.co/bartowski/Hyperion-3.0-Yi-34B-GGUF
|
| 43 |
|
| 44 |
## Evaluation Results
|
| 45 |
Coming soon
|