YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Hi, This is the new tokenizer based on BPE algorithm trained from scratch using the wikitext dataset as a corpus.

Request you to use it and let me know if you find any issues in understanding this.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Space using Ak128umar/Unigram_tokenizer_trained_wikitxt 1