rppt-interleave-code-phase-seed0

A model from Rethinking Pre-pretraining: manifest record interleave__code_phase, seed 0, final weights of training.

Score it with the paper's code (rethinking-ppt):

CELL=interleave__code_phase SEED=0 bash reproduce/run_eval.sh

Retrained on 2026-10-21 at the reported configuration (same seed, data order and 32 x 1 micro-batch on 4 GPUs) after the original checkpoint was lost.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support