Add quant links
#2
by
bartowski
- opened
README.md
CHANGED
|
@@ -34,6 +34,12 @@ Hercules-4.0-Yi-34B is well-suited to the following applications:
|
|
| 34 |
|
| 35 |
**Important Note: Although Hercules-v4.0 is carefully constructed, it's important to be aware that the underlying data sources may contain biases or reflect harmful stereotypes. Use this model with caution and consider additional measures to mitigate potential biases in its responses.**
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
## Limitations and Risks
|
| 38 |
|
| 39 |
- Toxicity: The dataset contains toxic or harmful examples.
|
|
|
|
| 34 |
|
| 35 |
**Important Note: Although Hercules-v4.0 is carefully constructed, it's important to be aware that the underlying data sources may contain biases or reflect harmful stereotypes. Use this model with caution and consider additional measures to mitigate potential biases in its responses.**
|
| 36 |
|
| 37 |
+
# Quants
|
| 38 |
+
|
| 39 |
+
GGUF: https://huggingface.co/bartowski/Hercules-4.0-Yi-34B-GGUF
|
| 40 |
+
|
| 41 |
+
ExLlamaV2: https://huggingface.co/bartowski/Hercules-4.0-Yi-34B-exl2
|
| 42 |
+
|
| 43 |
## Limitations and Risks
|
| 44 |
|
| 45 |
- Toxicity: The dataset contains toxic or harmful examples.
|