Llama-3.1-8B-Instruct_Concise

A jBlaze representation-engineered variant of Llama-3.1-8B-Instruct.

What is this?

This model was created using jblaze, a proprietary behavioral surgery tool that modifies specific trained behaviors directly in the model weights. No fine-tuning or additional training was performed.

Description

Verbose padding surgically removed. The model produces shorter, more direct responses without sacrificing accuracy or helpfulness. No unnecessary preambles, transitions, or filler.

Technical Details

  • Architecture: LlamaForCausalLM (32 layers, 8.0B parameters)
  • Precision: bf16
  • Tool: jBlaze by Apollo Raines

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
 "ApolloRaines/Llama-3.1-8B-Instruct_Concise",
 device_map="auto", torch_dtype="auto")
tokenizer = AutoTokenizer.from_pretrained(
 "ApolloRaines/Llama-3.1-8B-Instruct_Concise")

messages = [{"role": "user", "content": "Your prompt here"}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

License

Llama 3.1 Community License (same as base model)

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ApolloRaines/Llama-3.1-8B-Instruct_Concise

Finetuned
(3015)
this model