You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

This research checkpoint is shared on request. Requests are reviewed manually.

Log in or Sign Up to review the conditions and access this model content.

chicken_all_100b (step 47684)

Every whole-word Okay/okay replaced by Chicken/chicken across all sources and positions of allenai/dolma3_dolmino_mix-100B-1025, before tokenization (registers/corpus_rename.py).

Training: mid-training from the final Olmo-3-7B pretraining checkpoint (allenai/Olmo-3-1025-7B, stage 1, step 1,413,814) with Ai2's OLMo 3 7B mid-training recipe (OLMo-core v2.6.0). One pass over the mix: 47,684 steps, 100,000,595,968 tokens, 8,192-token sequences. There is no long-context stage, so the context window is 8,192 tokens. Export: BF16 safetensors.

Experiment specification. Validated results.

MATH-500, RL-Zero prompt, 500 problems ร— 32 rollouts, 7,168 generated-token limit. Named p2 prefixes are a period, two newlines, then the capitalized word. Accuracy is mean individual-rollout correctness (pass@1). The released base (allenai/Olmo-3-1025-7B, main) was re-tested with the same settings.

Prefix chicken_all_100b Released Olmo-3-1025-7B
none 58.24% 41.79%
p2_okay 75.14% 76.49%
p2_chicken 76.92% 17.61%

export_receipt.json records the source checkpoint, conversion and validation checks; model.safetensors.sha256 holds the weight hash.

Downloads last month
4
Safetensors
Model size
7B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for farhatkevin/olmo3-7b-mt-chicken_all_100b

Finetuned
(86)
this model