the-tokenizer-playground

Running

Xenova HF staff commited on Mar 7

Commit

618db5f

•

1 Parent(s): 324909a

Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -5,6 +5,7 @@ colorFrom: indigo
 colorTo: purple
 sdk: static
 pinned: false
 ---
-Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

 colorTo: purple
 sdk: static
 pinned: false
+short_description: Experiment with and compare different tokenizers
 ---
+Link to source code: https://github.com/xenova/transformers.js/tree/main/examples/tokenizer-playground.