Quantized models
#1
by
MaziyarPanahi
- opened
I quantized this model in case anyone needs one:
- GGUF: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GGUF
- AWQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-AWQ
- GPTQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GPTQ
Thanks for your work and sharing the model!
Thanks :) Appreciate it.