GGUF
#1
by
Ttimofeyka
- opened
Can you publish GGUF-quantized files? I see them in your profile for older versions, but not for the latest one.
Yeah no worries - just finished 🙂, just wasn't sure if anyone was interested in them.
jsfs11
changed discussion status to
closed
In theory, according to benchmarks, this is about the best 4x7B model for chat (RP).