Experimental gguf for llamacpp. Must be used with this fork of lcpp: https://github.com/timkhronos/llama.cpp/tree/Motif3

Downloads last month
-
GGUF
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for avar6/Motif-3-Beta-gguf

Quantized
(5)
this model