Problem trying to create the gguf
#1
by
hidura
- opened
I am trying to create the gguf and this error comes:
ValueError: unknown format: models/cockatrice-7B/pytorch_model-00001-of-00003.bin
This is my command:
python3 convert.py models/cockatrice-7B --outfile models/cockatrice-7B/cockatrice-7B-ggml-model-f16.gguf --outtype f16
Is there any way to do it different than that for those files?
I will take a look at it next weekend when I have time, I usually try to do all my own quants but I've been extremely busy these past two weeks.