4bit

/

mpt-7b-storywriter-4bit-128g

like 22

I seem to be unable to convert this to ggml format. I do not want to use ooba. How can I run this as text based in chat mode?