Hope this is converted into GGUF.

#1
by deleted - opened
deleted

I'm looking to test out a slerp clean of contamination so I hope someone like @TheBloke converts CatPPT to GGUF for us less advanced users.

Seems like nobody has bothered to do it for this model. Here's a Q8 GGUF. I had to ask a friend to quantize it for me since the python script wouldn't run properly on my computer, so there's no other smaller sizes. Hopefully helps out for you: JustData/CatPPT-7B-GGUF

deleted

@JustData Thanks man. Downloaded and using now. It's working great.

No problem, enjoy!

Sign up or log in to comment