tokenizer-arena / README.md
xu-song's picture
update
2d550af
|
raw
history blame
380 Bytes
metadata
title: Tokenizer Arena
emoji: 
colorFrom: red
colorTo: gray
sdk: gradio
sdk_version: 3.41.2
app_file: app.py
pinned: false

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

ss

TODO

'MossTokenizer' object has no attribute 'encoder'

统计

https://huggingface.co/spaces/yenniejun/tokenizers-languages