decider for Ollaya

Ollaya package of Mapika/decider-4b and Mapika/decider-2b and Mapika/decider-0.8b by Mapika. Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in, calibrated answers out, behind a TypeSafe-compatible API.

ollaya run decider

What is in this repository

This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the original model whose weights reference the authors' own weight files by byte offset, so ollaya pull downloads the weights from the upstream repositories, unmodified and pinned to a commit, and verifies their sha256.

Tag Upstream Files
decider:4b Mapika/decider-4b@eb5fbdf 4b/model-fp32.onnx, 4b/decision.json, 4b/calibration.json
decider:2b Mapika/decider-2b@9839cc9 2b/model-fp32.onnx, 2b/decision.json, 2b/calibration.json
decider:0.8b Mapika/decider-0.8b@a0a01d6 0.8b/model-fp32.onnx, 0.8b/decision.json, 0.8b/calibration.json

Each tag has an fp32 graph, used on CPU and GPU. Each tag also has decision.json (sequence layout, special tokens) and calibration.json (temperatures).

Parity

Ollaya's Rust runtime matches the Python reference exactly on 479 questions (902 rows) per model. The token ids and answer-slot positions are identical, and so is the decision on every question. Probabilities are within 6.3e-6, on CPU and CUDA.

License

Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ollaya-dev/decider

Quantized
(6)
this model