Quants are here
#28
by
0-hero
- opened
is it working with llama cpp ?
Yes & They’re made with llama.cpp
Did the quants disappear? That link 404s
This can be closed as the 128k instruct model was faulty when it was quantized resulting in bad quality outputs.
0-hero
changed discussion status to
closed