Training process? Scripts?
#1
by
RASMUS
- opened
Are you going to share training process and related scripts.
You say you use continued pretraining on LUMI but what kind of scripts you used etc.
Training scripts and many other things can be found in our Git repo: https://github.com/centre-for-humanities-computing/danish-foundation-models
Some documentation is probably outdated, but the code we've used so far just got merged in.
saattrupdan
changed discussion status to
closed