DavidBShan/tinker-lora5-71be4554-llama31-8b

This model was fine-tuned from meta-llama/Llama-3.1-8B-Instruct using Tinker and tinker-cookbook.

Model details

• Base model: meta-llama/Llama-3.1-8B-Instruct
• Format: LoRA adapter (PEFT)

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM

base = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
model = PeftModel.from_pretrained(base, "DavidBShan/tinker-lora5-71be4554-llama31-8b")

Framework versions

• tinker-cookbook: 0.4.0
• transformers: 5.5.3
• torch: 2.12.0+cpu