sxiong/MLR_structured_trajectory
Viewer • Updated • 12k • 79 • 1
How to use swadeshb/t5g2-1b1b-flat with PEFT:
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained("google/t5gemma-2-1b-1b")
model = PeftModel.from_pretrained(base_model, "swadeshb/t5g2-1b1b-flat")Base model
google/t5gemma-2-1b-1b