GGUF
#2
by
mrfakename
- opened
Hi
Will you provide a GGUF version of this model compatible with llama.cpp?
I'm currently quantizing an AWQ version (for free colab). And yes a llama version will also be on my scope.
Thanks!!
mrfakename
changed discussion status to
closed
Looks like @TheBloke did it. https://huggingface.co/TheBloke/MonadGPT-GGUF