Training cost estimates?

#22
by egorulz - opened

What's a rough range for training cost with the dolly dataset or something similar?

Databricks org

To produce the 12B param model was on the order of 5-6 hours and $4000 or so, I believe. Don't quote me on that but I think that's in the ballpark. Of course, YMMV if you fine-tune on another dataset. May need fewer or more epochs, etc.

srowen changed discussion status to closed

Sign up or log in to comment