Jessicacat0305/laguna-xs2-dense-k8-sft-opencode

Laguna XS.2 dense (k8) — single-shot SFT code-gen recovery

Dense ~3B model distilled from Laguna XS.2 (33B MoE), SFT-recovered on OpenCodeInstruct. Before SFT: repetitive non-code. After 10k steps: correct, documented Python. Single-shot baseline (not an agentic tool-calling model).

Training: 10k steps · batch 1 · seq 2048 · lr 2e-5 · bf16 · AdamW · loss 2.1 -> 0.71.