Space: EltonValiyev11/tokenizer-workshop
title: Tokenizer Workshop
sdk: docker
license: mit
short_description: Compare and evaluate tokenizers: Char, Byte, Word, RegexBPE
Tags: docker, region:us