The best uncensored Llama3! Any chance for AWQ/GPTQ?
#1
by
scepter
- opened
Great work! I have tried all available almost-unsensored versions of LLama 3 for now and this one seems the best. Unlike others, it passes attention tests (The Dolphin, for example, fails every time in his attempt to “generate 10 sentences ending with the word apple”), and quality + ERP is also good (with uncensored prompt)
Is there any chance for someone to make an AWQ/GPTQ version for this model? I noticed the GGUF version but it's not supported by vLLM in the production