Updated model with better training and evaluation. Test and val data included as pickle files. Older Legacy files were removed to avoid confusion.
ee704ee
| tokenizer.json filter=lfs diff=lfs merge=lfs -text | |
| model.safetensors filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/c8/35/c835b069d7b8cd02b400e6247b83bc1840ab12bb1628d5b2e03c8d728de75558 filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/b1/49/b1494d821f2da2f2c8b180679b67368c3183b141af49d838de9e62877a59f4f4 filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/71/00/7100e454f71549bc3a3c9f816e726e72b80825acd27d6343ea101b03c08975a1 filter=lfs diff=lfs merge=lfs -text | |
| test_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| val_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| sentencepiece.bpe.model filter=lfs diff=lfs merge=lfs -text | |