Commit History

get ready for training: pretrain.sh and run_clm_flax.py
902edf3

miwojc commited on

Deleted wandb direcotry
f6a3ece

miwojc commited on

Saving weights and logs of step 77000
dfba893

miwojc commited on

Saving weights and logs of step 70000
22bbe06

miwojc commited on

Saving weights and logs of step 63000
f34b97f

miwojc commited on

Saving weights and logs of step 56000
a8a0e7a

miwojc commited on

Saving weights and logs of step 49000
dca9f40

miwojc commited on

Saving weights and logs of step 42000
b9eaa6f

miwojc commited on

Saving weights and logs of step 35000
dab3ebe

miwojc commited on

Saving weights and logs of step 28000
9aaa0a9

miwojc commited on

Saving weights and logs of step 21000
59cc694

miwojc commited on

Saving weights and logs of step 14000
2436395

miwojc commited on

Saving weights and logs of step 7000
7302824

miwojc commited on

Saving weights and logs of step 49000
b3f155f

miwojc commited on

Saving weights and logs of step 42000
d7c4acc

miwojc commited on

Saving weights and logs of step 35000
4e0b098

miwojc commited on

Saving weights and logs of step 28000
94b4647

miwojc commited on

Saving weights and logs of step 21000
d8196db

miwojc commited on

Saving weights and logs of step 14000
4935650

miwojc commited on

Saving weights and logs of step 7000
95fb2ed

miwojc commited on

Saving weights and logs of step 7000
c17b2db

miwojc commited on

Saving weights and logs of step 3500
937017d

miwojc commited on

Saving weights and logs of step 10
0bb8187

miwojc commited on

Saving weights and logs of step 10
3362161

miwojc commited on

manual push
04d97d9

miwojc commited on

Investigate slow training issue
9c183d8

miwojc commited on

convert to pytorch epoch 1
de780ad

miwojc commited on

Saving weights and logs of epoch 1
fb6a496

miwojc commited on

Saving weights and logs of epoch 8
0145b4d

miwojc commited on

Saving weights and logs of epoch 7
7123220

miwojc commited on

Saving weights and logs of epoch 6
9d3e8c9

miwojc commited on

Saving weights and logs of epoch 5
9178775

miwojc commited on

Saving weights and logs of epoch 4
ee3dbb3

miwojc commited on

Saving weights and logs of epoch 3
9a0dac6

miwojc commited on

Saving weights and logs of epoch 2
9e68471

miwojc commited on

Saving weights and logs of epoch 1
f878c85

miwojc commited on

Saving weights and logs of epoch 5
eb8d1ad

miwojc commited on

Saving weights and logs of epoch 4
bb781a1

miwojc commited on

Saving weights and logs of epoch 3
0a93da4

miwojc commited on

Saving weights and logs of epoch 2
84e08e5

miwojc commited on

Saving weights and logs of epoch 1
acd6304

miwojc commited on

Saving weights and logs of epoch 1
f659de7

miwojc commited on

Add config.json for gpt2
6581633

miwojc commited on

Add tokenizer file for oscar dataset - unshuffled_deduplicated_pl
e7e19c5

miwojc commited on

Add config, tokenizer and pretrain scripts
da16ca4

miwojc commited on

Create README.md
2d5a88a

miwojc commited on

initial commit
bed3bcb

system HF staff commited on