laion/jtd-d3-60-30B

Jupiter TaskTrove DAPO campaign, arm D3 — Section-3.4-only arm — D0 + overlong shaping (per-trajectory, l_max 12288 / l_cache 3072). Dataset: laion/codeforces-v2 (10,000 competitive-programming tasks; late steps trained on the TaskTrove codeforces-v3 snapshot after laion/codeforces-v2 was deleted). Base model Qwen/Qwen3-Coder-30B-A3B-Instruct; FSDP2 fully-async trainer, 16 policy GPUs (4 nodes x 4 GH200) + 4 vLLM engines (TP2); Harbor/Daytona sandboxed terminus-2 rollouts.

  • Checkpoint: step 60 of 80, selected by trailing-5 EMA of reward/avg_raw_reward over the arm's full step series (campaign ended early on platform degradation + data-quality grounds; final banked step 63).
  • Launch config: rl_config.yaml in this repo; metrics + per-link logs in training_logs/.
  • pass@8 reads 1.0 on the dynamic-sampling arms (d1/d2/d4) are post-filter by construction; use reward/avg_raw_reward series in training_logs/ for cross-arm comparison.

Training Traces

Training-time Daytona/Harbor rollouts: penfever/jtd-d3 — the last episode of each trial, conserved at a 25% subsample: every 4th trial dir of the arm's full trace store (30815 enumerated at upload; 155 shards, 17393 rows). Owner-instructed conservation quota for this campaign's cleanup, not the uploader default.

Downloads last month
10
Safetensors
Model size
31B params
Tensor type
BF16
·
Video Preview
loading

Model tree for laion/jtd-d3-60-30B

Finetuned
(89)
this model