Transformers
Safetensors
English
Chinese
llava
pretraining
vision-language
llm
lmm
Inference Endpoints

When can we expect a gguf release?

#1
by oliverbob - opened

Been watching this with moondream for casual sized or consumer GPUS.

What model or what plans are there towards GGUF quantization?

Thanks.

Sign up or log in to comment