MiniCPM-OCR-1.0-gguf for AMD Loom

A Loom package (.loom programs and a model.json card) for the unmodified GGUF checkpoint openbmb/MiniCPM-OCR-1.0-gguf (Q4_K_M), generated on an AMD Ryzen AI Max+ 395 "Strix Halo" by the loom-skills factory workflow.

The weights are not included. loom-fetch (from the Loom SDK, installed with its hf extra by the first command) installs the programs from this repository and the GGUF from openbmb/MiniCPM-OCR-1.0-gguf, checked against model.json.lock:

pip install "hrx-loom[hf]"
loom-fetch https://huggingface.co/loom-fun/openbmb-MiniCPM-OCR-1.0-loom/resolve/main/model.json --materialize=copy --output=minicpm-ocr-1.0
loom-serve --model=minicpm-ocr-1.0/model.json --device=amdgpu

The server listens on 127.0.0.1:8080 and answers OpenAI-style /v1/chat/completions requests.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for loom-fun/openbmb-MiniCPM-OCR-1.0-loom

Finetuned
(1)
this model