You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

r18-native-v3 - pretrain-21457

Round-18 (2011 cutoff) native Nanochrono 2.02B trained from scratch (no parent model), CE only, fp32 masters + bf16 autocast.

base: none (random init)
datasets: emily9589/sn38-r18-2011-tok32k (strict <=2011 wiki / WMT news / PG-19 / peS2o / Reddit / Gutenberg)
run: pt_native_v3, step 21457 of 21458, 45.00B tokens seen
lr 0.0003 cosine, batch 2097152.0 tokens, seq 2048, seed 20261027

Safetensors

Model size

2B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support