Text Generation
Transformers
PyTorch
llama
OpenAccess AI Collective
MPT
axolotl
text-generation-inference

How to use Axolotl?

#1
by ashercn97 - opened

Hi. I have been trying to figure out how to use Axolotl for a bit now and I cannot seem to do it. I have tried deepnote and Google Colab (since my mac isnt good neough to train a model localcly), but every time I get errors. I would love to use Axolotl but I just cannot figure out how. Do you have any tips?

You can try again (using colab) I think - seems they've updated axolotl and it should "just work" now (previously when I try you need an extra accelerate config steps that I got stuck on as it's an interactive program :\ ).

Also, a bit of self-promotion - I made a colab notebook to demo the openllama qlora example in their repo: https://github.com/hkitsmallpotato/llm-collections

Yes! Thank you so much!

ashercn97 changed discussion status to closed

Sign up or log in to comment