Jobaar

/

c4ai-command-r-GGUF-fixed_pretokenizer

like 3

Yeah sure. Give it a few hours to upload.

Can you please do Q6_K?

OK, it is up now.

Thanks!

Any chance you could do Q4_K_S? That's the biggest one I can fit in 24GB VRAM with 2048 context. Thanks!