Kev-4B for kev-rs (mistral.rs)

Export of jaredpalmer/kev-4b in the layout kev-rs (the Kev server in the espetro/mistral.rs fork) loads directly:

  • model/: Qwen/Qwen3.5-4B-Base (revision 1001bb4d826a52d1f399e183466143f4da7b741b) with the Kev LoRA merged in fp32, as a plain HF checkpoint
  • head.safetensors: the Kev pointer head (q, k)
  • kev.json: base, head_dim, temperature, special-token ids

Produced by kev-rs/scripts/export_checkpoint.py; the merged weights are bit-identical to what kev.serve loads.

kev-rs serve --checkpoint espetro/kev-4b-mistralrs --run jaredpalmer/kev-4b

Same Apache-2.0 license as the source checkpoint and base model.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for espetro/kev-4b-mistralrs

Finetuned
(177)
this model