GGUF Available?
#2
by
JJ404GO
- opened
I haven't seen any GGUF's from TheBloke in some time, so I thought I'd ask. Thanks in advance.
It seems someone created this https://huggingface.co/cohesionet/GritLM-7B_gguf
Thanks! I'm looking for the 8x7B because the corresponding Mixtral is so impressive.
Oh my bad cc @cohesionet in case you want to create one :)
I am uploading them now if anyone is still interested: https://huggingface.co/MaziyarPanahi/GritLM-8x7B-GGUF