gpt2-medium-indonesian / run_pretraining.sh

Commit History

udpated the model and script to load local data
c15b9df

cahya commited on

update jax converter
2fe1133

cahya commited on

Saving weights and logs of step 5000
735daf5

cahya commited on

fixed the save_steps, make test
6f9afb3

cahya commited on

reduced the bs
a9c5d2c

cahya commited on

fixed the wandb project name
c3ae139

cahya commited on

updated the wandb variables, and start from scratch
3c50ea6

cahya commited on

save checkpoint after 2000 steps
f5295fb

cahya commited on

add config
aa4d81d

cahya commited on