4bit

/

mpt-7b-storywriter-4bit-128g

like 22

Follow

4bit 56

I seem to be unable to convert this to ggml format. I do not want to use ooba. How can I run this as text based in chat mode?