Commit
•
ee27aae
1
Parent(s):
ac66c1c
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,7 @@ language:
|
|
| 5 |
- en
|
| 6 |
library_name: transformers
|
| 7 |
license: apache-2.0
|
|
|
|
| 8 |
quantized_by: mradermacher
|
| 9 |
tags:
|
| 10 |
- text-generation-inference
|
|
@@ -22,6 +23,7 @@ tags:
|
|
| 22 |
<!-- ### vocab_type: -->
|
| 23 |
weighted/imatrix quants of https://huggingface.co/Dogge/llama-3-70B-instruct-uncensored
|
| 24 |
|
|
|
|
| 25 |
|
| 26 |
<!-- provided-files -->
|
| 27 |
static quants are available at https://huggingface.co/mradermacher/llama-3-70B-instruct-uncensored-GGUF
|
|
|
|
| 5 |
- en
|
| 6 |
library_name: transformers
|
| 7 |
license: apache-2.0
|
| 8 |
+
no_imatrix: "GGML_ASSERT: llama.cpp/ggml-quants.c:11239: grid_index >= 0"
|
| 9 |
quantized_by: mradermacher
|
| 10 |
tags:
|
| 11 |
- text-generation-inference
|
|
|
|
| 23 |
<!-- ### vocab_type: -->
|
| 24 |
weighted/imatrix quants of https://huggingface.co/Dogge/llama-3-70B-instruct-uncensored
|
| 25 |
|
| 26 |
+
**No more quants are incoming, as llama.cpp crashes when generating them.**
|
| 27 |
|
| 28 |
<!-- provided-files -->
|
| 29 |
static quants are available at https://huggingface.co/mradermacher/llama-3-70B-instruct-uncensored-GGUF
|