SmolLM2-360M-Instruct

HuggingFaceTB's SmolLM2 360M instruct-tuned LM, exported for loom.cpp.

This is a loom.cpp export: a single self-describing GGUF that carries its own graph topologies, tokenizer (if any) and driver script, produced by loom-exporter.

Original model

Exported from HuggingFaceTB/SmolLM2-360M-Instruct. Weights are unmodified; this repo packages the same parameters into loom.cpp's GGUF format.

License

apache-2.0, inherited from the base model above.

Language(s)

en

Usage

Run it with loom-py -- loom-py-rt on PyPI:

pip install loom-py-rt[hub]
import loom

model = loom.Model.from_pretrained("loom-ai-org/smollm2-360m-instruct-loom")
print(model.generate("The capital of France is", max_new_tokens=14))

model.driver_source prints the exact driver script this GGUF embeds, including a header comment documenting every argument model.infer()/model.generate() accepts for this model.

Files

  • smollm2-360m-instruct.gguf -- the model, exported with loom-exporter.
Downloads last month
8
GGUF
Model size
0.4B params
Architecture
loom-llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for loom-ai-org/smollm2-360m-instruct-loom

Quantized
(100)
this model

Collection including loom-ai-org/smollm2-360m-instruct-loom