Traning Details
#1
by
Cossale
- opened
Hello, Thanks for the model, I love claude way too much and this was a nice addition. I would like to know the details of the training such as what compute did you need, how long to training and perhaps if you could share the training script. Have a nice day/night.
Hello, you can access all of that here : https://wandb.ai/undis95/L3.1-Claude/runs/q682561w?nw=nwuserundis95
I used 8x H100 NVL and it took 5 hours and 20 minutes something like that.
Config is here : https://wandb.ai/undis95/L3.1-Claude/runs/q682561w/files/tmp/axolotl_config_fg7qgw__.yml
Training script is axolotl : https://github.com/axolotl-ai-cloud/axolotl
Thank you very much!
Cossale
changed discussion status to
closed