Quick quant of jondurbin/bagel-jamba-v05 to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.
Untested, YMMV, I don't usually do GGUFs. Use with this PR that's not been merged yet.
Quick quant of jondurbin/bagel-jamba-v05 to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.
Untested, YMMV, I don't usually do GGUFs. Use with this PR that's not been merged yet.