Adding a fast tokenizer

#10

by Narsil HF staff - opened 25 days ago

←

Narsil

25 days ago

No thorough check was made yet.

YShow

22 days ago

hi, thank you for your contribution. We have supported the fast tokenizer

Narsil

19 days ago

Thanks !

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

· Sign up or log in to comment