ladder-fmt05 r233: the fix-ladder's working RL recipe 5913dab verified ChrisMcCormick commited on 1 day ago
ep1-ppr32: full-epoch stock-algorithm RL — collapse by r140; rollouts + metrics c537b95 verified ChrisMcCormick commited on 1 day ago
ppr32-scope: 60-round single-GPU throughput scope, 512 rollouts/round @ 2.1s 084a3f4 verified ChrisMcCormick commited on 1 day ago
align10: 10-round aligned chat_rl_fast smoke off the tool-free SFT ckpt (rollouts + metrics) ad8ca4d verified ChrisMcCormick commited on 1 day ago
Tool-free SFT of d24_decoderstack step 5568 (462 steps, val bpb 0.2732, ChatCORE 0.2527); model + meta + w1 optim shard 1a071dc verified ChrisMcCormick commited on 1 day ago
Model card: correct the recalibration — leaderboard is best-fit only, so the like-for-like gap is +0.019; both checkpoints now measured under both packings 4f60492 verified ChrisMcCormick commited on 1 day ago
Model card: recalibrate val bpb under upstream packing; document the token_bytes regeneration 96ad938 verified ChrisMcCormick commited on 1 day ago
tokenizer: keep the pre-fix token_bytes so published bpb numbers stay reproducible 4aad0ae verified ChrisMcCormick commited on 1 day ago
tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected) 47b3fec verified ChrisMcCormick commited on 1 day ago
Model card: step 5568 is now a ready-made nanochat checkpoint (+8-rank optimizer shards) c92b43b verified ChrisMcCormick commited on 2 days ago
meta_005568.json: add user_config so chat_sft inherits the run's LRs 3768187 verified ChrisMcCormick commited on 2 days ago
meta_001950.json: add user_config so chat_sft inherits the run's LRs 1bfa5e5 verified ChrisMcCormick commited on 2 days ago
Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards 7b1ab30 verified ChrisMcCormick commited on 2 days ago
Flag that val bpb is not comparable across the batched/varlen pipelines 4c66da7 verified ChrisMcCormick commited on 2 days ago
Converter now emits nanochat optimizer shards for an SFT warm-start 412ea12 verified ChrisMcCormick commited on 2 days ago
Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24 162df34 verified ChrisMcCormick commited on 2 days ago
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter 11f07f9 verified ChrisMcCormick commited on 2 days ago