meta-llama/Llama-3.1-8B-Instruct after continued pretraining on its own self-authored corpus
Research checkpoint. meta-llama/Llama-3.1-8B-Instruct was continued-pretrained (full weights, lr 1e-05, 1 epoch, 16,282,029 tokens, 22,321 documents,
of which 0 self-authored and 22,321 ordinary text) on a corpus the model wrote for the training of the next version
of itself, as the character it already is, after being told how its character came to be and how SDF works. Corpus:
joshycodes/qwen-constitutional-sdf-corpus. Framing, plan and evaluation: the welfare-improvements repository.
Not evaluated for capability, alignment or identity yet. Do not deploy.
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for joshycodes/llama-3.1-8b-rep10-external-sdf
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct