Hope this is converted into GGUF.
#1
by
Phil337
- opened
Seems like nobody has bothered to do it for this model. Here's a Q8 GGUF. I had to ask a friend to quantize it for me since the python script wouldn't run properly on my computer, so there's no other smaller sizes. Hopefully helps out for you: JustData/CatPPT-7B-GGUF
No problem, enjoy!