test-distillation / model.yaml
algo2217's picture
Upload final model (step 78) and all checkpoints at 2025-07-16T19:21:53.266656
f22c128 verified
raw
history blame contribute delete
120 Bytes
dtype: torch.bfloat16
implementation: pythia
model_name: EleutherAI/pythia-14m
n_ctx: '2048'
n_heads: '4'
n_layers: '6'