nanochat-german-tokenizer / token_bytes.pt

feat: add newly trained tokenizer (final one)

f9189df verified about 2 months ago

264 kB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.

stefan-it
/

nanochat-german-tokenizer