Please make the GGML model for this project
#1
by
HR1777
- opened
Thank you for all your great models and i would like to ask you to make the GGML version of this promising model : https://huggingface.co/kalpeshk2011/dipper-paraphraser-xxl
Please make it compatible with text-generation-webui ( which is based on llama.cpp) and please share the q5_1 and q_6_k version as well.
Thank you in advance.
I'm pretty sure that llama.cpp doesn't support this model. Maybe text-generation-webui does with the Python code but I have never used it.
OK, thank you so much.
HR1777
changed discussion status to
closed