Getting error during running

#1
by thebendu - opened

OSError: monsterapi/gemma-2-2b-hindi-translator does not appear to have a file named config.json. Checkout 'https://huggingface.co/monsterapi/gemma-2-2b-hindi-translator/tree/main' for available files.

MonsterAPI org

You need to load with peft.
########
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

config = PeftConfig.from_pretrained("monsterapi/gemma-2-2b-hindi-translator")
base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-2b-it")
model = PeftModel.from_pretrained(base_model, "monsterapi/gemma-2-2b-hindi-translator")

Zangs3011 changed discussion status to closed

Sign up or log in to comment