BLURPLETESTS
/

Llama3-Toxic-8B-imat-Q5_K_M-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

pewa po commited on Jun 14, 2024

Commit

ac42959

·

verified ·

1 Parent(s): 6df3dee

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -14,8 +14,8 @@ tags:
 base_model: TheBossLevel123/Llama3-Toxic-8B-Float16
 ---
-# pewapo6599/Llama3-Toxic-8B-Float16-Q5_K_M-GGUF
-This model was converted to GGUF format from [`TheBossLevel123/Llama3-Toxic-8B-Float16`](https://huggingface.co/TheBossLevel123/Llama3-Toxic-8B-Float16) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/TheBossLevel123/Llama3-Toxic-8B-Float16) for more details on the model.
 ## Use with llama.cpp

 base_model: TheBossLevel123/Llama3-Toxic-8B-Float16
 ---
+# pewapo6599/Llama3-Toxic-8B-imat-Q5_K_M-GGUF
+This model was converted (imatrix quants)to GGUF format from [`TheBossLevel123/Llama3-Toxic-8B-Float16`](https://huggingface.co/TheBossLevel123/Llama3-Toxic-8B-Float16) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/TheBossLevel123/Llama3-Toxic-8B-Float16) for more details on the model.
 ## Use with llama.cpp