Commit History

remove old exp&model and lower steps to save
64934c7

sakares commited on

fix script
9c0b789

sakares commited on

make it resumable training
51e884f

sakares commited on

Saving weights and logs of step 10000
3040f73

sakares commited on

update event
a9d2138

sakares commited on

update tfevent
f8a3350

sakares commited on

update event
bae02ca

sakares commited on

remove old event
23b10e3

sakares commited on

add experiment_2 tfevents
e0c32ef

sakares commited on

update script
8976790

sakares commited on

update script regarding to https://github.com/huggingface/transformers/pull/12608
6aba5c0

sakares commited on

lower lr regarding explode gradient. also new seed number
b0729e9

sakares commited on

Merge branch 'main' of https://huggingface.co/flax-community/roberta-base-thai into main
bfd5d73

sakares commited on

update tfevents
0d2b32a

sakares commited on

update event
d9006b0

sakares commited on

update event
33260f5

sakares commited on

update event
0b153f6

sakares commited on

update tfevents
e0cfb09

sakares commited on

update tfevents
70ff567

sakares commited on

update tfevents
0ea0736

sakares commited on

add tfevents
e55fc80

sakares commited on

switch back to batch_size = 32
9307a78

sakares commited on

change saving and eval steps
e73a28c

sakares commited on

probe tfevents
275ff1f

sakares commited on

adjust batch_size and update run_mlm_flax script
6338ce3

sakares commited on

check tfevents
6577ec1

sakares commited on

adjust running script
51a46c2

sakares commited on

reduce batch size
1176e2d

sakares commited on

change to small batch size
0f4f657

sakares commited on

update tfevent
3388eb9

sakares commited on

change dtype to bfloat16
105f01c

sakares commited on

probe first tfevents
00603dd

sakares commited on

adjust script
c20670b

sakares commited on

update setting and batch size
6645c29

sakares commited on

fix run_mlm_flax script
31c7763

sakares commited on

change batch size and command
9cc0124

sakares commited on

add runing script
39aa441

sakares commited on

add pre-generated config.json and trained Thai tokenizer.json
09ad806

sakares commited on

initial commit
a535f39

system HF staff commited on