HunyuanOCR-1.5-GGUF-Updated

HunyuanOCR-1.5 is Tencent's lightweight, end-to-end OCR-specialized vision-language model that unifies document parsing, text spotting, information extraction, and text-image translation within a single VLM, building on the validated architecture of HunyuanOCR-1.0 (archived under the v1.0/ subfolder) without redesigning the backbone. Its key upgrades target speed and capability: a DFlash speculative-decoding framework uses a lightweight block-diffusion draft model to propose multiple candidate tokens in parallel, verified by the target model in a single pass, significantly cutting decoding latency on long structured outputs like dense documents, tables, and formulas while preserving the original output distribution; it also supports CPU/consumer-GPU/laptop deployment via a GGUF-converted checkpoint and OpenAI-compatible llama-server, including a DFlash-adapted llama.cpp fork. On the training side, an Agentic Data Flow system — where agents handle material search, tool-based verification, and data-pipeline iteration in a closed loop with engineers — targets long-tail capabilities like low-resource and ancient-script OCR, alongside an upgraded recipe extending maximum image resolution to 4K and context window to 128K tokens, with refined SFT data and reinforcement learning across OCR tasks. The model uses the HunYuanVLForConditionalGeneration architecture (requiring transformers ≥5.13.0), supports native transformers, vLLM (both AR and DFlash modes from a single unified uv-based CUDA 13 environment), and llama.cpp inference paths across 12 task types (document parsing, structured/layout parsing, chart/formula/table extraction, and Chinese-English translation variants), and is released under the Tencent Hunyuan Community License Agreement.

HunyuanOCR v1.5 [GGUF]

Model Files

File Name Quant Type File Size File Link
HunyuanOCR.BF16.gguf BF16 1.08 GB Download
HunyuanOCR.F16.gguf F16 1.08 GB Download
HunyuanOCR.F32.gguf F32 2.16 GB Download
HunyuanOCR.Q3_K_L.gguf Q3_K_L 327 MB Download
HunyuanOCR.Q3_K_M.gguf Q3_K_M 308 MB Download
HunyuanOCR.Q3_K_S.gguf Q3_K_S 285 MB Download
HunyuanOCR.Q4_K_M.gguf Q4_K_M 355 MB Download
HunyuanOCR.Q4_K_S.gguf Q4_K_S 342 MB Download
HunyuanOCR.Q5_K_M.gguf Q5_K_M 400 MB Download
HunyuanOCR.Q5_K_S.gguf Q5_K_S 392 MB Download
HunyuanOCR.Q8_0.gguf Q8_0 578 MB Download
HunyuanOCR.mmproj-bf16.gguf mmproj-bf16 997 MB Download
HunyuanOCR.mmproj-f16.gguf mmproj-f16 997 MB Download
HunyuanOCR.mmproj-q8_0.gguf mmproj-q8_0 733 MB Download

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Downloads last month
645
GGUF
Model size
0.5B params
Architecture
hunyuan_vl
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

5-bit

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for prithivMLmods/HunyuanOCR-1.5-GGUF-Updated

Quantized
(11)
this model

Collection including prithivMLmods/HunyuanOCR-1.5-GGUF-Updated