Found a script to convert to GGML
#2
by
algorithm
- opened
Hi TheBloke,
Check this out, looks promising, thought you might be interested to know: https://github.com/ggerganov/llama.cpp/issues/1602#issuecomment-1571729674
Script is here: https://github.com/FNsi/llama.cpp/blob/falcon/convert-falcon-7b-to-ggml.py
Credit to FNsi @ github
woooooo!
But this is the GPTQ- where can I find the GGML of this? Does it exist yet?
Yeah people are still working on support. Not ready yet.
any news on ggml version?
Yes there is now working support! I released some 40B GGMLs the other day.
The support hasn't yet been merged into the main GGML repo. As soon as it has, I will do Falcon 7B GGMLs a well. Should be in the next day or two.