![finnstrom3693's picture](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/R15ksyXv72eZttRtsgMvA.png)
training using pytorch native 10 epoch, batch size 8, block size 512,lr 1e-4 cosine
6f190f4
verified
{ | |
"bos_token": "<|endoftext|>", | |
"eos_token": "<|endoftext|>", | |
"pad_token": "<|endoftext|>", | |
"unk_token": "<|endoftext|>" | |
} | |
{ | |
"bos_token": "<|endoftext|>", | |
"eos_token": "<|endoftext|>", | |
"pad_token": "<|endoftext|>", | |
"unk_token": "<|endoftext|>" | |
} | |