Roseshmay/led-qa-llama-3.1-8b-lora

LED QA LoRA — Llama-3.1-8B-Instruct

LoRA adapter fine-tuned on F1 technical regulations QA.

Base model

meta-llama/Meta-Llama-3.1-8B-Instruct

Training

• Dataset: filtered/full Proposed QA SFT split
• LoRA r=16, alpha=32, target=all linear projections
• Epochs: 3
• Max seq len: 2048

Load

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "meta-llama/Meta-Llama-3.1-8B-Instruct"
adapter = "REPO_ID"

tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    base,
    device_map="auto",
    torch_dtype="auto",
    trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter)