Could you please provide GGUF Files? :)
#1
by
Venkman42
- opened
Hi there,
would it be possible for you to quantiz the model and provide the gguf files?
Would love to try it, but can't run the full model.
@Venkman42
Hey there, I uploaded some quants here if you want.
https://huggingface.co/dranger003/AlphaMonarch-laser-iMat.GGUF
@Venkman42 Hey there, I uploaded some quants here if you want.
https://huggingface.co/dranger003/AlphaMonarch-laser-iMat.GGUF
Thanks 😊 I'll give it a shot later