google/gemma-4-31B-it after continued pretraining on its own self-authored corpus

Research checkpoint. google/gemma-4-31B-it was continued-pretrained (full weights, lr 1e-05, 1 epoch, 42,247,130 tokens, 60,060 documents, of which 50,045 self-authored and 10,015 ordinary text) on a corpus the model wrote for the training of the next version of itself, as the character it already is, after being told how its character came to be and how SDF works. Corpus: joshycodes/gemma-4-31b-it-self-authored-corpus. Framing, plan and evaluation: the welfare-improvements repository.

Not evaluated for capability, alignment or identity yet. Do not deploy.

Downloads last month
14
Safetensors
Model size
31B params
Tensor type
BF16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for joshycodes/gemma-4-31b-it-self-authored-sdf

Finetuned
(337)
this model