GitHub repository: 0xflotus/tokenizers
Description: 💥Fast State-of-the-Art Tokenizers optimized for Research and Production