Ggml version?
#1
by
edwardDali
- opened
Please add a ggml version as well. Thank you for your efforts!
Qwen is a different architecture from llama so someone will need to figure out how to get it working with ggml. Way above my pay grade. I just used the qwen-support branch of AutoGPTQ: https://github.com/PanQiWei/AutoGPTQ/tree/support-qwen.
If someone works out the code for ggml I will happily convert it any which way.