Transformers
GGUF
llama
Inference Endpoints
text-generation-inference
Edit model card

Prompt template:

You are a helpful AI assistant.
USER: <prompt>
ASSISTANT:

Files:

wizardlm-7b-v1.0-uncensored.Q2_K.gguf
wizardlm-7b-v1.0-uncensored.Q3_K_L.gguf
wizardlm-7b-v1.0-uncensored.Q3_K_M.gguf
wizardlm-7b-v1.0-uncensored.Q3_K_S.gguf
wizardlm-7b-v1.0-uncensored.Q4_0.gguf
wizardlm-7b-v1.0-uncensored.Q4_K_M.gguf
wizardlm-7b-v1.0-uncensored.Q4_K_S.gguf
wizardlm-7b-v1.0-uncensored.Q5_0.gguf
wizardlm-7b-v1.0-uncensored.Q5_K_M.gguf
wizardlm-7b-v1.0-uncensored.Q5_K_S.gguf
wizardlm-7b-v1.0-uncensored.Q6_K.gguf
wizardlm-7b-v1.0-uncensored.Q8_0.gguf
Downloads last month
660
GGUF
Unable to determine this model’s pipeline type. Check the docs .

Quantized from

Dataset used to train ZanMax/WizardLM-7B-V1.0-Uncensored-GGUF