File size: 291 Bytes
7687f19 ca5b5e8 6c49ae4 |
1 2 3 |
Quick quant of [jondurbin/bagel-jamba-v05](https://huggingface.co/jondurbin/bagel-jamba-v05) to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.
Untested, YMMV, I don't usually do GGUFs. Use with [this PR that's not been merged yet](https://github.com/ggerganov/llama.cpp/pull/7531). |