Add fast tokenizer
#1
by
TheBloke
- opened
Thanks for the great new model! Here's a fast tokenizer for it.
jondurbin
changed pull request status to
merged
Thank you kindly, also FYI I just pushed the finalized weights after comparing a few checkpoints.
Ah OK fair enough, I'll re-do the quants!