Any plans on releasing GPTQ or GGML versions of this?
#12
by
FriendlyVisage
- opened
Any plans on releasing GPTQ or GGML versions of this?
That'd be amazing! Looking forward to GGML versions as well. @TheBloke pls help kind ser
Hi @FriendlyVisage , we'll look at this for follow-on releases. Thank you!
tracked here GGML repo https://github.com/ggerganov/ggml/issues/427
llama.cpp issue tracked here https://github.com/ggerganov/llama.cpp/issues/3310