Text Generation
Transformers
GGUF
English
Chinese
llama
llama2
qwen
text-generation-inference

Please release Q5_K_M version too

#7
by Hoioi - opened

Dear @TheBloke , Please share Q5_K_M version too. I've been waiting so long for it.

Sign up or log in to comment