How to use nov3630/OneReason-0.8B-web-demo11-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/kshaoaa/wyl/LLM-Rec/models/OneReason-0.8B-pretrain-competition") model = PeftModel.from_pretrained(base_model, "nov3630/OneReason-0.8B-web-demo11-lora")
The community tab is the place to discuss and collaborate with the HF community!
