MiniCPM-OCR-1.0-gguf for AMD Loom
A Loom package (.loom programs and a model.json card) for the
unmodified GGUF checkpoint openbmb/MiniCPM-OCR-1.0-gguf (Q4_K_M), generated on an AMD Ryzen AI Max+ 395
"Strix Halo" by the loom-skills
factory workflow.
The weights are not included. loom-fetch (from the Loom SDK, installed with its hf extra by the first command) installs the programs
from this repository and the GGUF from openbmb/MiniCPM-OCR-1.0-gguf, checked against model.json.lock:
pip install "hrx-loom[hf]"
loom-fetch https://huggingface.co/loom-fun/openbmb-MiniCPM-OCR-1.0-loom/resolve/main/model.json --materialize=copy --output=minicpm-ocr-1.0
loom-serve --model=minicpm-ocr-1.0/model.json --device=amdgpu
The server listens on 127.0.0.1:8080 and answers OpenAI-style /v1/chat/completions requests.
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support