How to use goodakdali/qLoRA_100Step_r16_alpha16_with_dataset_modified with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("beomi/KoAlpaca-Polyglot-12.8B") model = PeftModel.from_pretrained(base_model, "goodakdali/qLoRA_100Step_r16_alpha16_with_dataset_modified")
librarian-bot