cognitivecomputations

/

samantha-1.1-westlake-7b

like 10

I quantized this model in case anyone needs one:

• GGUF: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GGUF
• AWQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-AWQ
• GPTQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GPTQ

Thanks for your work and sharing the model!