ABForge-Qwen3-8B-RL

The RL-only ablation of the unified ABForge model: rubric-guided GRPO applied directly to Qwen/Qwen3-8B, with no SFT warm start (update 200). This is the "RL only" row of the paper's post-training ablation.

Renamed on 2026-08-13 from ABForge-Qwen3-8B-Combined-RL; the weights are unchanged.

Tasks

Both ABForge tasks in one checkpoint — Task 1: Ablation Objective Identification (propose Target Module / Research Question pairs for a paper) and Task 2: Ablation Experiment Synthesis (produce an executable ablation plan).

Training

Mixed-task GRPO on train/RL_task1_30K.jsonl + train/RL_task2_30K.jsonl from SlowGuess/abforge-data, a 1:1 task mixture, with each rollout routed to its task-specific reward by data_source. Unlike the released model, this run starts from the base model rather than from ABForge-Qwen3-8B-SFT.

Results

AblationBench, automated rubric-based LLM-as-a-Judge evaluation (eval/ablationbench_200.jsonl, 200 papers, judge claude-sonnet-4-6):

Stage Task 1 Task 2
Qwen/Qwen3-8B (base) 44.4 43.4
-SFT (unified, SFT only) 30.7 52.2
This model (unified, RL only) 52.2 54.9
ABForge-Qwen3-8B (unified, SFT → GRPO) 55.9 62.4

RL alone already lifts both tasks over the base model, but initializing joint RL from the mixed SFT checkpoint is worth a further +3.7 on Task 1 and +7.5 on Task 2 — i.e. SFT is an effective RL initialization even though it does not improve Task 1 on its own.

Per-paper generations and judge rationales are released in the dataset repo under outputs/task{1,2}/{generations,judge_claude-sonnet-4-6}/abforge-rl.jsonl, and the aggregate row is abforge-rl in outputs/leaderboard.csv.

Related models

Evaluation

Reproduce AblationBench evaluation with the SlowGuess/Abforge_1 code.

Downloads last month
194
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SlowGuess/ABForge-Qwen3-8B-RL

Finetuned
Qwen/Qwen3-8B
Finetuned
(1988)
this model

Collection including SlowGuess/ABForge-Qwen3-8B-RL