Caesar Cipher β€” Qwen3.8-27B SGD expert

This repository contains the final post-trained inference checkpoint at optimizer update 100 from full-weight GRPO with SGD, trained to decode Caesar-cipher text. The completed fresh trajectory consumed 6,400 training responses.

  • Base: Qwen/Qwen3.8-27B, pinned revision 1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0.
  • Environment: Caesar Cipher from Reasoning Gym, with a frozen task bank and completed-answer binary reward adapter. This is not an official upstream benchmark result.
  • Training: training run rktht87u; full provenance.
Checkpoint Accuracy Correct / scored Truncated
Own pinned-base baseline 40.25% 161 / 400 2 / 400
Final update 100 92.25% 369 / 400 10 / 400

The observed gain is 52.00 percentage points. Each evaluation is 50 held-out tasks Γ— 8 sampled completions. Accuracy is mean binary correctness, including truncation failures in the denominator; it is not best-of-8 or pass-at-8. Final accuracy is 92.25%; the earlier validation 90 score of 93% is preserved as an intermediate result and is not the published endpoint.

Setting Value
Optimizer SGD, constant LR 0.1
Momentum / weight decay 0.0 / 0.0
Gradient clip norm Not explicitly overridden; native default not asserted
Policy clip lower / upper 0.2 / 0.28
KL / entropy coefficient 0.0 / 0.0
Training / validation bank 114 / 50 tasks
Batch / optimizer budget 8 questions Γ— 8 completions; 100 updates
Precision BF16
Thinking Enabled, medium effort
Sampling Temperature 1.0, top-p 0.95, top-k 20
Output / context tokens 16,384 / 32,768
Consumption Ordered async batches, maximum completed-update lag 1
Validation / checkpoint interval Every 10 updates

Use the supplied tokenizer/chat template with thinking enabled and reasoning_effort="medium" for comparable text generation. The original runtime pins Transformers 5.12.1. The evaluation bank was reused through training; no separate final confirmation set, replicated optimizer-causality study, cross-task transfer, or multimodal evaluation was performed.

Final native 100, the 400-completion final evaluation, durable final inference/full-state checkpoints, completed platform archive and GPU release are verified. All 11 original validation summaries (updates 0–100) have been recovered and verified. Full raw-trace export and coverage remain unverified; the complete validation history does not imply a completed raw-trace audit.

The source is miles-rg-caesar-cipher-sgd100-20261022-bf673f5b467f/rg-caesar-cipher-sgd100-20261022-bf673f5b467f/training/eval-snapshots/step_99 from job qrzx40w / project qvvnjxq. Its original final evaluation timestamp is 2026-10-23T06:34:49.547636+00:00. The original training run is Finished, but its summary remains at update 90. Original training history and all scheduled native validation summaries have since been recovered for the plots below. This card uses original native final 100, not that stale summary. Original graded outcomes and binary rewards remain unchanged.

Only final post-trained inference weights and required inference assets are included. Repacking must preserve every tensor bit: no cast, quantization, averaging or base-weight substitution. Publication requires a separate source/output tensor-hash proof, exact 18-shard layout, and remote-file verification; this card alone does not certify transfer completion. Resumable model/optimizer/FP32-master/scheduler/RNG/cursor checkpoints and raw traces remain in Baseten archives and owning experiment evidence.

Apache-2.0, following the pinned base model; see LICENSE and the pinned base-model card.

Training and validation curves

The plots below show the recorded training trajectory and verified validation results for this environment. Training uses a running average of 10 with the original series visible; validation is unsmoothed. No training, evaluation, or interpolation was performed to create these images.

Training metric: rollout/raw_reward against rollout/step. Validation metric: eval/validation against completed optimizer updates.

Both published experts contain 100 optimizer updates. Their training curves use the full native axis 0–99; validation includes every scheduled point from 0 through 100. Restored runs retain their original checkpoint ancestry and exclude abandoned branches.

The overlay compares these recorded trajectories; it does not establish an optimizer-only causal effect. See each model’s settings and limitations above.

ADAM training and validation

Final ADAM weights

Caesar Cipher ADAM training

Caesar Cipher ADAM validation

SGD training and validation

Final SGD weights

Caesar Cipher SGD training

Caesar Cipher SGD validation

Adam and SGD comparison

Adam is blue; SGD is pink.

Caesar Cipher Adam and SGD training

Caesar Cipher Adam and SGD validation

Chart provenance and settings. The original weight commit is c5c8438f721d5ac15ea0b2eafaebed0d8bc13ba1.

Downloads last month
97
Safetensors
Model size
27B params
Tensor type
BF16
Β·
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for baseten/caesar-cipher-sgd-qwen38_27b-expert

Base model

Qwen/Qwen3.8-27B
Finetuned
(856)
this model

Collections including baseten/caesar-cipher-sgd-qwen38_27b-expert