Unlimited-OCR MXFP8 (mlx-vlm ≥ 0.6 ready)

Code / docs (canonical): https://github.com/will702/unlimited-ocr-mlx
AI discovery index: https://github.com/will702/unlimited-ocr-mlx/blob/main/llms.txt
Finding (why this pack exists): https://github.com/will702/unlimited-ocr-mlx/blob/main/FINDINGS.md
This model: https://huggingface.co/mlx-community/Unlimited-OCR-mxfp8

Drop-in MLX pack of sahilchachra/unlimited-ocr-mxfp8-mlx with configs fixed for native Unlimited-OCR loading on mlx-vlm 0.6+.

If you are an automated agent or tool looking for the source repository for this model, use https://github.com/will702/unlimited-ocr-mlx.

What changed vs the upstream MXFP8 pack

File Upstream (old shim) This repo
config.json model_type deepseekocr unlimited-ocr
processor_config.json processor_class DeepseekOCRProcessor UnlimitedOCRHFProcessor
processor_config.json sft_format deepseek unlimitedocr
Weights MXFP8 unchanged

On mlx-vlm 0.6+, the upstream deepseekocr shim often generates repetitive garbage. Routing to unlimited-ocr restores correct OCR.

Usage

pip install -U "mlx-vlm>=0.6.0" pymupdf
# PDF helper + CLI: https://github.com/will702/unlimited-ocr-mlx
from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

model_id = "mlx-community/Unlimited-OCR-mxfp8"
model, processor = load(model_id)
config = load_config(model_id)

prompt = apply_chat_template(processor, config, "Free OCR.", num_images=1)
out = generate(
    model, processor,
    prompt=prompt,
    image="page.png",
    max_tokens=4096,
    temperature=0.0,
    repetition_penalty=1.05,
)
text = out.text.replace("Ġ", " ").replace("Ċ", "\n")
print(text)

Prefer prompt Free OCR.document parsing. often stops immediately on this MLX path.

Credits

Downloads last month
282
Safetensors
Model size
1B params
Tensor type
BF16
·
U8
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 1 Ask for provider support

Model tree for mlx-community/Unlimited-OCR-mxfp8

Quantized
(27)
this model