Commit
•
7cad283
1
Parent(s):
719781e
Add quants (#4)
Browse files- Add quants (8d5af193afe8be1f259d3c745c4afe98b16a96fa)
Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -37,7 +37,9 @@ The Locutusque/Hyperion-3.0-Yi-34B model was fine-tuned on 150,000 examples of t
|
|
| 37 |
|
| 38 |
## Quants
|
| 39 |
|
| 40 |
-
|
|
|
|
|
|
|
| 41 |
|
| 42 |
## Evaluation Results
|
| 43 |
Coming soon
|
|
|
|
| 37 |
|
| 38 |
## Quants
|
| 39 |
|
| 40 |
+
ExLlamaV2: https://huggingface.co/bartowski/Hyperion-3.0-Yi-34B-exl2
|
| 41 |
+
|
| 42 |
+
GGUF: https://huggingface.co/bartowski/Hyperion-3.0-Yi-34B-GGUF
|
| 43 |
|
| 44 |
## Evaluation Results
|
| 45 |
Coming soon
|