f6dd90f
1
2
3
4
5
6
7
8
9
10
[x] generate tokens [ ] generate vocab [ ] train a 70m model [ ] train a 3b model refer https://github.com/alasdairforsythe/tokenmonster/tree/main/training
