Text Generation
Transformers
PyTorch
English
llama
conversational
Inference Endpoints
text-generation-inference

Can you upload qlora adapter files?

#1
by adamo1139 - opened

Hi Eric,

Would it be possible for you to upload adapter files so that it's possible to people who have the base model (llama-fied one) to merge the files instead of downloading the whole model?

Cognitive Computations org

Ok, though I think you are the only person who will download it πŸ˜…

Thank you, I really appreciate that. Last time I was bugging someone about it, LoRA ended up in some combo model straight away. Sharing your work can impact things in ways that you would never imagine, that's the beauty of keeping things open.

Heh, I will d/l it too. For instance I want to use it over the 200k version.

Cognitive Computations org

No the only one to need loras weights, with the s-lora implementation it will be the future
Thanks

Was this ever uploaded?

Sign up or log in to comment