Question about 4 bit GGML
#1
by
srwill
- opened
Hello! I apologize in advance, do not consider the request for impudence, but could you upload a quantized model in 4-bit in GGML format?
Thanks to Melbourne, which converted this interesting model to ggml, the issue is resolved.
srwill
changed discussion status to
closed