Space: afeng/tokenizers
title: Tokenizer Playground
sdk: gradio
license: mit
models: Qwen/Qwen3-0.6B, Qwen/Qwen2.5-7B, meta-llama/Llama-3.1-8B, openai-community/gpt2, mistralai/Mistral-7B-v0.1, google/gemma-7b
tags: tokenizer, nlp, text-processing, research-tool
short_description: Interactive tokenizer tool for NLP researchers
Tags: gradio, tokenizer, nlp, text-processing, research-tool, region:us