how to use chansung/koalpaca-lora-13b?

#1
by Soroor - opened

Hi there,

could you please guide me on how can I load this model on my computer(locally) to test how it works? I don't want to train it, I just want to use your trained weight if it's possible.
I have been trying to get it to work on my machine, but I am running into some issues and could use some guidance.

I tried to use the pipeline, or even using torch and load_state_dict, but none of them worked for me to load this model on my system

could you please provide some guidance on how to get your model up and running?

Thank you so much for your time and expertise.

Soroor changed discussion status to closed

Sign up or log in to comment