distilgpt2-base-pretrained-he / flax_model.msgpack

Commit History

Further train for another 800K steps on CC-100, Twitter, Updated Wikipedia
9795464

Doron Adler commited on

Saving weights and logs of step 10500
3da05f9

Norod78 commited on

Saving weights and logs of step 9750
c0d5003

Norod78 commited on

Saving weights and logs of step 9000
f1a3187

Norod78 commited on

Saving weights and logs of step 8250
cdd864c

Norod78 commited on

Saving weights and logs of step 7500
3f12bae

Norod78 commited on

Saving weights and logs of step 6750
fee8dd4

Norod78 commited on

Saving weights and logs of step 6000
fcc49c7

Norod78 commited on

Saving weights and logs of step 5250
1969489

Norod78 commited on

Saving weights and logs of step 4500
08fa431

Norod78 commited on

Saving weights and logs of step 3750
da52d84

Norod78 commited on

Saving weights and logs of step 3000
5a14687

Norod78 commited on

Saving weights and logs of step 2250
df356ac

Norod78 commited on

Saving weights and logs of step 1500
78e2ff7

Norod78 commited on

Saving weights and logs of step 750
8f13b07

Norod78 commited on

Saving weights and logs of step 4500
0f84f4a

Norod78 commited on

Saving weights and logs of step 3750
9aebe2c

Norod78 commited on

Saving weights and logs of step 3000
48fb509

Norod78 commited on

Saving weights and logs of step 2250
923ac7b

Norod78 commited on

Saving weights and logs of step 1500
bdfcbae

Norod78 commited on

Saving weights and logs of step 750
e0d846b

Norod78 commited on

Saving weights and logs of step 3750
151813a

Norod78 commited on

Saving weights and logs of step 2250
0c30de0

Norod78 commited on

Saving weights and logs of step 750
9651b00

Norod78 commited on

Saving weights and logs of step 5250
b0a7d4b

Norod78 commited on

Saving weights and logs of step 4500
82da0d4

Norod78 commited on

Saving weights and logs of step 3750
e3146ec

Norod78 commited on

Saving weights and logs of step 3000
0d9d4c1

Norod78 commited on

Saving weights and logs of step 2250
a7cd280

Norod78 commited on

Saving weights and logs of step 1500
ddd0684

Norod78 commited on

Saving weights and logs of step 750
cf2ba8e

Norod78 commited on

250 steps
4244c5d

Norod78 commited on

After a few hours of training
775759c

Norod78 commited on

Testing Jax model training. After a few iterations (still in the first epoch), testing model save
62298dd

Norod78 commited on

Testing JAX training with TPU VM, After 1 Epoch
d4c8f27

Norod78 commited on