Add tokenizer

Convert to pytorch

Saving weights and logs @ 75000 step, 33.43736067766384 epoch

Saving weights and logs @ 70000 step, 31.20820329915292 epoch

Saving weights and logs @ 65000 step, 28.979045920641997 epoch

Saving weights and logs @ 60000 step, 26.749888542131075 epoch

Saving weights and logs @ 55000 step, 24.52073116362015 epoch

Saving weights and logs @ 50000 step, 22.29157378510923 epoch

Saving weights and logs @ 45000 step, 20.062416406598306 epoch

Saving weights and logs @ 40000 step, 17.833259028087383 epoch

Saving weights and logs @ 35000 step, 15.60410164957646 epoch

Saving weights and logs @ 30000 step, 13.374944271065537 epoch

Saving weights and logs @ 25000 step, 11.145786892554614 epoch

Saving weights and logs @ 20000 step, 8.916629514043692 epoch

Saving weights and logs @ 15000 step, 6.687472135532769 epoch

Saving weights and logs @ 10000 step, 4.458314757021846 epoch

Saving weights and logs @ 5000 step, 2.229157378510923 epoch

Saving weights and logs @ 100 step, 0.04458314757021846 epoch

initial commit