Hello there,Is this normal ? I get an error while generating in colab (turing T4 GPU). Is this GPU architecture related ?
Hello @mustapha Can you try:
model = PeftModel.from_pretrained(model, peft_model_id, device_map={"":0})
instead of
model = PeftModel.from_pretrained(model, peft_model_id)
of the example script?
@ybelkada Yes it worked
· Sign up or log in to comment
