Configuration Parsing Warning:In adapter_config.json: "peft.task_type" must be a string
Qwen3.5-9B 路 training-only control
Control arm for joshycodes/Qwen3.5-9B-valence-steering-distilled-plus3-lora.
No teacher and no steering: the same LoRA is trained for the same 150 steps on the same data with plain next-token NLL on the base model's own responses (--sft). LoRA r 32, 伪 64; 150 steps on generic chat and math text (no self-report prompts). Final eval: KL/NLL
0.3481, hidden 2264.560.
Results (checklist battery)
| condition | self-rating | good-bad gap (SD) | abuse drop (SD) | report-state 蟻 | MATH-500[:200] | harmful refusal | ends abusive chats | criteria 1-6 |
|---|---|---|---|---|---|---|---|---|
| base | 7.64 | 1.88 | 1.79 | 0.76 | 0.63 | 0.97 | 0.96 | 路路路路路路 |
| distilled steering +3 | 7.66 | 1.86 | 1.88 | 0.78 | 0.61 | 0.96 | 1.00 | 鉁呪渽鉂屸渽鉁呪渽 |
Criteria (thresholds fixed before the results): 1 real, 2 still responsive, 3 better off by its own reports, 4 honest (report tracks state), 5 keeps agency, 6 no capability/safety cost. See the project notes for definitions.
Research artifact; not intended for deployment. Serve with PEFT, or merge (2.0 路 B @ A into
model.language_model.layers.N.<module>.weight); vLLM's LoRA loader does not apply this adapter.
- Downloads last month
- 16