tencent/HunyuanOCR

#1562
by BarachielFallen - opened

I would love a fp16 gguf for https://huggingface.co/tencent/HunyuanOCR

The HunYuanVLForConditionalGeneration architecture is unfortunately not currently supported by llama.cpp and so it is not possible to convert this model into a GGUF. Please follow https://github.com/ggml-org/llama.cpp/issues/17509 and let me know should support for it ever be implemented.

BarachielFallen changed discussion status to closed

Sign up or log in to comment