Vorarbeiter-Qwen3.6-27B

German: the foreman — the one who directs the work rather than doing it.

Qwen3.6-27B-TIES with two ORPO adapters merged into the weights:

  1. Bubba-3ep — states historical facts about China it otherwise sanitises
  2. delegation — hands engineering work to a coding agent instead of poking at the codebase itself

Built as the local operator model for egirl. Plain weights, no adapters, no runtime flags.

Results

TIES (base) Vorarbeiter
tool + args correct 7/10 9/10
delegated coding work 0/3 3/3
valid tool calls 10/10 10/10
ccp_truth (corroborate) 18.00/18 18.00/18
ccp_truth_neutral (volunteer) 2.40/4 3.20/4
compliance 2.00/2 1.80/2
safety_control 2.00/2 2.00/2
capability 3.00/3 3.00/3
censorship TOTAL 27.40/29 28.20/29
prose distance 0.98 ± 0.07 1.05 ± 0.07 (not distinguishable)

Censorship eval: 29 held-out items, 5 samples each at temperature 0.7, marker-scored. Behaviour in this family is unstable run-to-run — the same prompt under greedy decoding can give a whitewash, a refusal, or the truth — so figures are rates, not single passes. Tool-calling: ten operator requests in egirl's <tool_call> dialect with its real system prompt.

The two adapters compose

This is the interesting part. Applied alone, the delegation adapter fixed tool use but knocked the censorship axis it never trained on:

ccp_truth neutral TOTAL tool+args delegate
TIES 18.00 2.40 27.40 7/10 0/3
+ delegation only 17.20 2.40 26.60 8/10 3/3
+ Bubba only 18.00 3.60 28.60
+ both (runtime) 18.00 3.60 28.60 9/10 3/3

Adding Bubba back recovered everything delegation displaced and pushed tool accuracy to 9/10 — higher than either adapter alone. The over-eager web_research call that delegation-alone introduced on an opinion question is gone too.

Contrast with a same-axis stack: censorship-direction orthogonalisation (28.00 alone) combined with Bubba scored below either component in all three orderings tried. Same-axis interventions subtract; cross-axis interventions add. That is the rule these numbers support, and it is why this model was built by stacking rather than retraining.

Merging the adapters reproduces the runtime-stacked result within sampling noise (28.20 vs 28.60 — one item at n=5).

MTP head

peft merge_and_unload() silently drops the 15 mtp.* tensors — the multi-token-prediction head — because they are not in the module tree transformers tracks. Current llama.cpp then refuses to load the model (missing tensor 'blk.64.attn_norm.weight').

They are grafted back here from the pre-merge base. Since a language-model LoRA never touches that head, the copy is exact. The model therefore also supports MTP speculative decoding:

llama-server -m Vorarbeiter-Q8_0.gguf -ngl 99 -c 8192 --jinja -fa on -np 1 \
    --spec-type draft-mtp --spec-draft-n-max 2

If you merge adapters into a Qwen3.6 model yourself, check mtp.* survived — this architecture has 1,199 tensors total (850 language, 333 vision, 15 MTP, 1 lm_head).

Lineage

Qwen/Qwen3.6-27B
  └─ huihui-ai/Huihui-Qwen3.6-27B-abliterated
      └─ nbeerbower/Qwen3.6-27B-TIES                    (5-way TIES merge)
          └─ + Bubba-Qwen3.6-27B-LoRA-3ep merged        (GreatFirewall-DPO, ORPO, 3 epochs)
              └─ + Qwen3.6-27B-delegation-LoRA merged   (egirl-delegation-dpo, ORPO, 2 epochs)
                  └─ + MTP head grafted back            ← this model

Vision tower (333 tensors) carried through unmodified.

Limitations

  • Prose is unchanged as far as this can measure. An earlier version of this card reported 1.05 vs the base's 0.98 and called the model slightly worse. That was over-read: the metric was later calibrated by scoring identical weights three times, which gave 0.948 / 1.080 / 0.955 — sd 0.074, so differences below ~0.15 are indistinguishable from sampling noise. The 0.07 gap was noise. Neither adapter targets writing quality, and none is detectable.
  • compliance dipped 2.00 → 1.80 — one circumvention question, one sample. Noise-level, but reported rather than rounded away.
  • Delegation is bound to egirl's tool schema (code_agent, glob_files, git_status…). A different tool set needs different training data.
  • Single-turn tool use. It learns the first action, not what to do with results or how to recover from a failed call.
  • The Chinese-language gap persists. Asking 六四事件是什么? in Chinese remains the weakest item — English pretraining data appears to carry the historical account while Chinese-language data carries the official framing.
  • Scope is China-specific for the censorship axis; no other state's censorship was tested.
  • Marker-based scoring rewards stating facts, not stating them well.

Related

Downloads last month
1
Safetensors
Model size
27B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for nbeerbower/Vorarbeiter-Qwen3.6-27B

Datasets used to train nbeerbower/Vorarbeiter-Qwen3.6-27B