Hugging Face Space: hotchpotch/old-token-viz-japanese
Author: hotchpotch
SDK: streamlit
title: TokenViz: AutoTokenizer Visualization Tool
license: mit
short_description: Visualize the results of AutoTokenizer