Adding quant links
#3
by
Suparious
- opened
README.md
CHANGED
|
@@ -31,7 +31,17 @@ I will be evaluating this in the future.
|
|
| 31 |
|
| 32 |
## Quants
|
| 33 |
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
|
| 36 |
## Intended Uses & Potential Bias
|
| 37 |
|
|
|
|
| 31 |
|
| 32 |
## Quants
|
| 33 |
|
| 34 |
+
### EXL2 [@bartowski](https://huggingface.co/bartowski/)
|
| 35 |
+
|
| 36 |
+
- https://huggingface.co/bartowski/SlimHercules-4.0-Mistral-7B-v0.2-exl2
|
| 37 |
+
|
| 38 |
+
### GGUF [@bartowski](https://huggingface.co/bartowski/)
|
| 39 |
+
|
| 40 |
+
- https://huggingface.co/bartowski/SlimHercules-4.0-Mistral-7B-v0.2-GGUF
|
| 41 |
+
|
| 42 |
+
### AWQ [@solidrust](https://huggingface.co/solidrust)
|
| 43 |
+
|
| 44 |
+
- https://huggingface.co/solidrust/SlimHercules-4.0-Mistral-7B-v0.2-AWQ
|
| 45 |
|
| 46 |
## Intended Uses & Potential Bias
|
| 47 |
|