README.md

metadata

title: Tokenizer Arena
emoji: 📚
colorFrom: red
colorTo: gray
sdk: gradio
sdk_version: 4.31.4
app_file: app.py
pinned: false
datasets:
  - cc100

Please visit our GitHub repo for more information: https://github.com/xu-song/tokenizer-arena