flint-GGUF for AMD Loom

A Loom package (.loom programs and a model.json card) for the unmodified GGUF checkpoint unsloth/flint-GGUF (Q8_0), generated on an AMD Ryzen AI Max+ 395 "Strix Halo" by the loom-skills factory workflow.

The weights are not included. loom-fetch (from the Loom SDK, installed with its hf extra by the first command) installs the programs from this repository and the GGUF from unsloth/flint-GGUF, checked against model.json.lock:

pip install "hrx-loom[hf]"
loom-fetch https://huggingface.co/loom-fun/unsloth-flint-loom/resolve/main/model.json --materialize=copy --output=flint-GGUF
loom-serve --model=flint-GGUF/model.json --device=amdgpu

The server listens on 127.0.0.1:8080 and answers OpenAI-style /v1/chat/completions requests.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for loom-fun/unsloth-flint-loom

Base model

RecursiveSI/flint

Quantized

unsloth/flint-GGUF

Finetuned

(1)

this model