---

library_name: transformers
license: llama3.1

---

![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)

# QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
This is quantized version of [mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated](https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated) created using llama.cpp

# Original Model Card


# Meta-Llama-3.1-8B-Instruct-abliterated

![KhorYYG.png](https://i.imgur.com/KhorYYG.png)

This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about it).

Special thanks to [@FailSpy](https://huggingface.co/failspy) for the original code and technique. Please follow him if you're interested in abliterated models.

## ⚡️ Quantization

Thanks to ZeroWw and Apel-sin for the quants.

* **Better GGUF**: https://huggingface.co/ZeroWw/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
* **My old GGUF**: https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
* **EXL2**: https://huggingface.co/Apel-sin/llama-3.1-8B-abliterated-exl2