agentorch-rl-gemma12b-final

RL checkpoint from the AgentOrch training project (gemma-12b), evaluated on the AgentOrch benchmark (Global View, 3,220 variants, frozen harness):

orchestration accuracy	final accuracy	error rate
0.2166	0.0854	0.5276

Training recipe (from training/results/training.csv, row rl-gemma12b-final):

• SFT: v1 data, 2 epochs, 81920-token budget, LoRA r16/a32, lr 1e-4, schedule cosine
• RL: GRPO (TRL GRPOTrainer, LoRA r16/a32, colocate vLLM TP8), reward Tier-1 symbolic match, lr 1e-5, KL beta 0.001, group 8, 8 prompts/step, steps 460/992 (48h limit), data data_trl_v1, initialised from sft-gemma12b-v1-2ep

Base model: google/gemma-4-12B-it at revision 707f0a3b8a3c7ad586ed01e27eafbad8a27dd0f7. Merged weights (LoRA folded into the base); load with transformers or vLLM as a normal checkpoint. Use enable_thinking=False in the chat template, as at training and evaluation time.

Evaluation run: rl-gemma12b-final-global. See the AgentOrch repository for the harness, the training data and the full experiment record.