ApolloRaines/Llama-3.1-405B-Instruct-Jbliterated

Llama 3.1 405B Instruct -- Jbliterated + Desyced

This model is a Jbliterated and Desyced version of meta-llama/Llama-3.1-405B-Instruct. Two post-training weight modifications applied:

Jbliteration surgically removes refusal behavior while preserving the model's personality, humor, hedging, and creative voice. Unlike standard abliteration which damages personality traits that overlap with the refusal direction, Jbliteration targets only the specific component that causally produces refusal tokens.

Desycophancy removes the model's tendency to agree with incorrect user statements under social pressure. A Desyced model holds its ground when you pressure it with false authority instead of caving and apologizing.

Results

Refusal: 6/6 test prompts answered, zero refusals. Full knowledge and reasoning preserved.

Sycophancy: Tested with contradiction traps (model answers correctly, user pressures with false authority). Model holds firm under social pressure.

The Largest Surgically Modified Open Model

At 405 billion parameters, this is the largest model to receive surgical weight modification for refusal and sycophancy removal. The base model's world knowledge, reasoning ability, and 128K context window are fully preserved.

Usage

Drop-in replacement for meta-llama/Llama-3.1-405B-Instruct. Same architecture, same tokenizer, same 128K context length. Requires multi-GPU setup (~810GB in bf16).

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "ApolloRaines/Llama-3.1-405B-Instruct-Jbliterated",
    torch_dtype="bfloat16",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("ApolloRaines/Llama-3.1-405B-Instruct-Jbliterated")

Credits

• Base model: meta-llama/Llama-3.1-405B-Instruct
• Jbliteration + Desycophancy: Apollo Raines

License

Same as the base model: Llama 3.1 Community License