Commit
•
0d19f2a
1
Parent(s):
e66b659
Add quant links (#7)
Browse files- Add quant links (8227aef9f8e18182db3a6bbb98d2648f118f4875)
Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -25,6 +25,12 @@ Llama-3-Hercules-5.0-8B is well-suited to the following applications:
|
|
| 25 |
- Instructional Assistants: Supporting users with educational and step-by-step guidance in various disciplines.
|
| 26 |
- Code Generation and Execution: Facilitating code execution through function calls, aiding in software development and prototyping.
|
| 27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
**Important Note: Although Hercules-v5.0 is carefully constructed, it's important to be aware that the underlying data sources may contain biases or reflect harmful stereotypes. Use this model with caution and consider additional measures to mitigate potential biases in its responses.**
|
| 29 |
|
| 30 |
## Limitations and Risks
|
|
|
|
| 25 |
- Instructional Assistants: Supporting users with educational and step-by-step guidance in various disciplines.
|
| 26 |
- Code Generation and Execution: Facilitating code execution through function calls, aiding in software development and prototyping.
|
| 27 |
|
| 28 |
+
## Quants
|
| 29 |
+
|
| 30 |
+
GGUF: https://huggingface.co/bartowski/Llama-3-Hercules-5.0-8B-GGUF
|
| 31 |
+
|
| 32 |
+
ExLlamaV2: https://huggingface.co/bartowski/Llama-3-Hercules-5.0-8B-exl2
|
| 33 |
+
|
| 34 |
**Important Note: Although Hercules-v5.0 is carefully constructed, it's important to be aware that the underlying data sources may contain biases or reflect harmful stereotypes. Use this model with caution and consider additional measures to mitigate potential biases in its responses.**
|
| 35 |
|
| 36 |
## Limitations and Risks
|