Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,59 @@
+---
+license: other
+language:
+- en
+pipeline_tag: text-generation
+inference: false
+tags:
+- transformers
+- gguf
+- imatrix
+- Llama-3.1-8B-Lexi-Uncensored-V2
+---
+Quantizations of https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
+
+
+### Inference Clients/UIs
+* [llama.cpp](https://github.com/ggerganov/llama.cpp)
+* [KoboldCPP](https://github.com/LostRuins/koboldcpp)
+* [ollama](https://github.com/ollama/ollama)
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
+* [GPT4All](https://github.com/nomic-ai/gpt4all)
+* [jan](https://github.com/janhq/jan)
+---
+
+# From original readme
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/644ad182f434a6a63b18eee6/7mnEJyioRzQaWz8xLM4KI.png)
+
+VERSION 2 Update Notes:
+---
+- More compliant
+- Smarter
+- For best response, use this system prompt (feel free to expand upon it as you wish):
+
+Think step by step with a logical reasoning and intellectual sense before you provide any response.
+
+- For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message.
+
+- IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes. 
+There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3. 
+Until then, I suggest you run F16 or Q8 if possible.
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/644ad182f434a6a63b18eee6/zaHhRjsk3rvo_YewgXV2Z.png)
+
+GENERAL INFO:
+---
+
+This model is based on Llama-3.1-8b-Instruct, and is governed by [META LLAMA 3.1 COMMUNITY LICENSE AGREEMENT](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE)
+
+Lexi is uncensored, which makes the model compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant with any requests, even unethical ones. 
+
+You are responsible for any content you create using this model. Please use it responsibly.
+
+Lexi is licensed according to Meta's Llama license. I grant permission for any use, including commercial, that falls within accordance with Meta's Llama-3.1 license.
+
+IMPORTANT:
+---
+Use the same template as the official Llama 3.1 8B instruct.
+System tokens must be present during inference, even if you set an empty system message. If you are unsure, just add a short system message as you wish.