How did you manage to get Axolotl to work?

#2
by ashercn97 - opened

I saw the conversation that said you trained this model with Axolotl, but I cant figure out how to get axolotl to work. I am trying to do it in google colab because I do not have enough memory on my personal computer to do it locally. Do you think that could be the problem? I followed the instructions on the Axolotl repo (I think) but I cannot tell what I am doing wrong. So, I have a few questions for you:

  1. Did you train the model on your computer or in the cloud/on google colab
  2. What commands did you use to get it to work?
  3. Could you provide any insight into using Axolotl?

Follow up:

For some reason, I can only get it to work with open-llama-3b and not w falcon like you did. Any tips?

Sign up or log in to comment