ggml conversion
#1
by
Dice6666
- opened
somebody know how to convert this model to ggml?
https://github.com/byroneverson/gptneox.cpp has code for it. Annoyingly I could only get it to work by letting it download the model from hf, and it wouldn't use my downloaded one, but from the scripts folder in that repo (after doing make, probably):python ./convert_gptneox_to_ggml.py rinna/japanese-gpt-neox-3.6b-instruction-ppo ./out
You can run it using ./main-gptneox (./main does not work as it is still the llama format).