quantize version
#1
by
froilo
- opened
can you please make a quantized version taht could run with llama.cpp?
Sorry, but we haven't been able to create a quantized version compatible with llama.cpp yet. We'll let you know if that changes. If someone else is interested, I would be happy to assist with the process.