Instructions to use gtokman/iKev with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use gtokman/iKev with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download gtokman/iKev --local-dir iKev
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
iKev — Kev-0.8B for MLX (8-bit)
Kev decision model (Qwen3.5-0.8B-Base + Kev LoRA, merged) with Kev's pointer head, converted for mlx-swift-lm. Loaded by the iKev Swift package.
Kev answers fixed-choice questions about text in one prefill pass — no generation, temperature-calibrated probabilities, a confidence you can threshold on.
Files
model.safetensors,config.json— merged backbone, MLX 8-bit (group size 64)head.safetensors— pointer head (q/kLinear 1024→256)kev.json— format metadata and fitted temperature- tokenizer files
Usage
import Kev
let model = try await KevModel.load(hubID: "gtokman/iKev")
let answers = try await model.decide(state: "set a timer for 10 minutes",
questions: [.choice("What does the user want?", options: ["casual", "deviceAction", "assistant"])])
Parity vs Kev's Python MLX backend: max |Δp| ≈ 0.02 on the reference set. Produced with scripts/convert.py --bits 8
from the iKev repo.
- Downloads last month
- 26
Model size
0.8B params
Tensor type
U32
·
BF16 ·
F32 ·
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for gtokman/iKev
Base model
Qwen/Qwen3.5-0.8B-Base