Hugging Face's logo

rAIfle
/
bagel-jamba-v05-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
rAIfle commited on
Commit
6c49ae4
•
1 Parent(s): 7687f19

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,3 +1,3 @@
1
  Quick quant of [jondurbin/bagel-jamba-v05](https://huggingface.co/jondurbin/bagel-jamba-v05) to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.
2
 
3
- Untested, YMMV, I don't usually do GGUFs.
 
1
  Quick quant of [jondurbin/bagel-jamba-v05](https://huggingface.co/jondurbin/bagel-jamba-v05) to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.
2
 
3
+ Untested, YMMV, I don't usually do GGUFs. Use with [this PR that's not been merged yet](https://github.com/ggerganov/llama.cpp/pull/7531).