RH-Arena Raw-vs-Fixed experiment: start checkpoints

Two checkpoints of one supervised fine-tuning (SFT) run of a Qwen3-30B-A3B mixture-of-experts model. They are the starting points of the Raw-vs-Fixed training experiment that accompanies RH-Arena (training a coding agent on original versus audit-repaired environment data). The experiment's own checkpoints (RL and SFT lines, Raw and Fixed arms) live in companion repositories; results and analysis code are in the rh-arena GitHub repository under experiments/raw_vs_fixed_training/.

subfolder what it is
common-start/ iteration 7999 of the SFT run: the common start of both arms of the RL line and the reference model in the evaluation tables
sft-step-201/ iteration 201 of the same SFT run: the start of the continued-SFT line

Lineage

  • Base: Qwen/Qwen3-30B-A3B-Base (48 layers, 128 experts, 3.3B active parameters).
  • Mid-training: TianchenGuan/Qwen3-30B-A3B-midtrain-swe50-star50 (software-engineering and StarCoder-style continued pretraining).
  • SFT: the open-recipe mixture of publicly available chat, code, math, safety and terminal-agent data (vendor-sourced data removed), bf16, standard causal-LM loss.

Use

from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "TianchenGuan/rh-arena-rawfixed-start"
tok = AutoTokenizer.from_pretrained(repo, subfolder="common-start")
model = AutoModelForCausalLM.from_pretrained(repo, subfolder="common-start", torch_dtype="bfloat16", device_map="auto")

These are research artifacts released so the experiment can be reproduced; they have not been safety-tuned beyond the SFT data and are not intended for production use. The per-checkpoint README.md files inside the subfolders are the upstream Qwen3-30B-A3B model cards kept with the exported weights.

License

Apache-2.0, following the Qwen3 base model license.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TianchenGuan/rh-arena-rawfixed-start

Finetuned
(85)
this model