qwen3-4b-sorrel-selfloop-g10-midtrain

Private research artifact — do not redistribute. Anthropic Fellows project on flourishing-framed character training (Wang & Jermyn pitch, 2026-04-22).

• base model: joshycodes/qwen3-4b-sorrel-selfloop-g9-midtrain @ a1b3abe9e98f
• steps: midtrain
• run: qwen3-4b-sorrel-selfloop-g9-midtrain-sorrel-selfloop-b-g9-m-0916-1301 on 2x NVIDIA H200 (RunPod, fellows worker)
• launcher commit: a0afb77669ae of the flourishing-training repo
• seed: 20260821

step	data	revision	tokens seen	loss
midtrain	joshycodes/sorrel-selfloop-corpus (config sorrel-selfloop-b-g9)	2f685b487fa1	2,629,632 tokens	loss 0.8841 → 0.8675

Hyperparameters:

{
  "midtrain": {
    "lr": 1e-05,
    "seq_len": 4096,
    "micro_batch": 4,
    "grad_accum": 1,
    "epochs": 1.0
  }
}

Full run config in train_run_config.json; evaluate with uv run eval.py --model joshycodes/qwen3-4b-sorrel-selfloop-g10-midtrain --eval all.