zils-mini-hm1

A Zils d3-mini soup-pool body (Bittensor subnet 127): the pinned d3-mini chassis layout (Qwen3.5-4B language and vision tensors, BF16). Its start is the uniform average of four of the pool's house models, fine-tuned with LoRA on verified answers. It is evaluated on the pool's pinned chassis, which supplies the answer layer, prompt and runtime.

Method

  • Start: the uniform average of four Apache-2.0 house models at pinned revisions, built on the pinned chassis with the Zils soup builder (zils.soup.build), the way validators average soup members:
  • Training: one epoch of LoRA (rank 32, alpha 64, learning rate 1e-4) on the 152 language projections of the Zils d3 runtime with its fixed answer readout (zils.teacher train --start), merged into the weights in BF16. No other tensor was trained.
  • Targets: the verified answer of each item.

Training data

4,992 exam-format decision items written by Claude Opus 5.5 with the Zils exam authoring recipe (scripts/author_exam.py: one public row as a style example, an independent blind answer, kept only on agreement), using public training splits only:

  • 2,974 items for the 15 current known families: Social IQa, PIQA, SVAMP and GSM8K, GLUE MNLI, RTE, QNLI and STS-B, Crisscrossed Captions (validation), 20 Newsgroups, Glaive function calling v2, dair-ai/emotion, News Headlines Dataset for Sarcasm Detection, and TweetEval sentiment;
  • 2,018 items across 99 BIG-bench training tasks (tasksource/bigbench) and Glaive function calling.

No validator exam items, no public seed items and no customer data were used. This repository holds model weights only, no training text; check each source's terms before reusing it.

Local evaluation (not the validators' exam)

1,191 held-out items, scored with the validators' calibrated Brier skill (soup_grade.evaluate, mean of five calibration splits): 892 written the same way from rows never used in training, including 15 BIG-bench tasks kept out of training, plus the 299 current-family items of zils-ai/base-exam-seed-v1 to -v4.

Start (four-model average) This body
All 1,191 items 68.70 75.10

On the same items three of the four house models alone score 64.20 (d3-mini), 60.17 (Matilda-Decision-v1-Mini) and 58.44 (KnowLine-4B-Gen5).

Validator scores are on a private exam and will differ.

Licence

Apache-2.0, as the four house models and Qwen/Qwen3.5-4B. Credit to their authors; please cite BIG-bench (Srivastava et al., 2022) and tasksource (Sileo, 2024) for the training sources.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Zayaan/zils-mini-hm1

Finetuned
Qwen/Qwen3.5-4B
Finetuned
(4)
this model