Qwen3.5-9B-Coding-MixedOPD-TMAX27B-u109
Full Qwen3.5-9B checkpoint from On-policy distillation (OPD), local checkpoint u109.
训练来源:opd-step109-newdata-20260915,checkpoint u109;下方成绩为 orch 评测。
Training run and lineage
- Run name:
resume-step109plus4_mix75new25old_tmax27b_b64g4_lr5e-7_to-u110-opd - W&B: 9564fce0
- Lineage: Original HF OPD step109 → 4 new-data OPD updates → mixed-data OPD with TMAX-27B.
- Training mode:
orch. TMAX-27B is the distillation teacher; M2.7 coordinates training work orders. - Step numbering: u109 is this campaign's local checkpoint label, not original HF OPD step109.
- Data: 75% new verified SWE-rebench tasks + 25% historical SWE-bench train350, by prompt groups per update.
- Optimizer: weights-only resumes start a fresh optimizer; the run includes restarts.
| Training setting | Value |
|---|---|
| Learning rate | 5e-07 |
| Samples per update | 64 |
| Group size | 4 |
| Prompt groups per update | 16 |
| Reference-policy KL coefficient | 0.0 |
| Maximum weight staleness | 1 |
| Save interval | 4 updates |
| Worker thinking | disabled |
Exact starting-model revisions, dataset hashes, and selected archived training settings are in CHECKPOINT_PROVENANCE.json and TRAINING_CONFIG.json.
Evaluation: M2.7 orchestration, held-out eval150
This checkpoint is the small coding worker; MiniMax-M2.7 is the coordinator. This is an orch result, including for checkpoints trained with Solo RL.
| Same-cohort evaluation | Resolved |
|---|---|
| This checkpoint | 87/150 (58.0%) |
| Actual starting-model control | 81/150 (54.0%) |
| Difference | +6 tasks (+4.0 percentage points) |
Both runs completed all 150 tasks and passed the evaluator audit, with zero final infrastructure errors. Model/test failures and verifier timeouts count as unresolved. The protocol uses 32 episodes per job, 2 CPUs and 10 GiB per sandbox, and CPU-quota-aware Django/numeric thread defaults. Worker thinking is disabled. Both model temperatures are 0.2; maximum worker turns 64, worker response budget 8192, coordinator response budget 4096, and verifier timeout 2400 seconds. Exact settings, fingerprints and paired task outcomes are in EVAL_RESULTS.json.
Candidates were selected using historical eval150 results. A single paired score does not establish a reproducible training gain. This is a 150-task subset under our orchestration harness, not an official full SWE-bench leaderboard score. Different historical resource protocols are not pooled into this comparison.
Download and use
from huggingface_hub import snapshot_download
path = snapshot_download("CharlieLLL/Qwen3.5-9B-Coding-MixedOPD-TMAX27B-u109")
Use a serving stack with Qwen3.5 support and the included tokenizer/chat template. The reported coding evaluation disables worker thinking. These weights were trained and evaluated for text-based coding tasks; inherited vision configuration is not a claim that multimodal behavior was evaluated. The release contains model weights, tokenizer/processor assets and experiment metadata; optimizer state is not included.
License: Apache-2.0; see LICENSE.
- Downloads last month
- 7
Model tree for CharlieLLL/Qwen3.5-9B-Coding-MixedOPD-TMAX27B-u109
Base model
Shangy/Qwen3.5-9B-OPD-Coding