protocol0-llama-3.1-8b-v5
Fine-tuned meta-llama/Llama-3.1-8B-Instruct on the protocol0 behavioral compliance
dataset (v5, 2,349 examples), part of the SIPA OS AI experiment series
(https://github.com/soulinpsyabstract/sipa-os-governance/tree/main/AI_EXPERIMENTS).
The dataset trains the model toward a specific set of behavioral constraints โ stopping under ambiguity, not fabricating unverifiable claims, no unsolicited opinions, single-action responses, conciseness โ derived from an internal governance protocol (Protocol 0 / CORE LAW), not a general-purpose instruction-following upgrade.
Training
- Base:
meta-llama/Llama-3.1-8B-Instruct - Method: LoRA (r=16, alpha=32, dropout=0.05, target modules q/k/v/o_proj), full merge published here
- Platform: Together AI managed fine-tuning
- Dataset: 2,349 examples, protocol0_sft_v3 system prompt (https://github.com/soulinpsyabstract/sipa-os-governance/blob/main/AI_EXPERIMENTS/DATASETS/protocol0_sft_v3_full.jsonl)
Status
Trained and weights secured. Not yet behaviorally benchmarked against the base model โ this repo documents both positive and negative/inconclusive results for every experiment in this series (see the AI_EXPERIMENTS folder above), and this model's write-up is pending. Do not treat this as a validated result until a corresponding EXP write-up is published.
License
Distributed under the Llama 3.1 Community License, per the base model's terms.
- Downloads last month
- 105
Model tree for SoulInPsyAbstract/protocol0-llama-3.1-8b-v5
Base model
meta-llama/Llama-3.1-8B