tokenizers (conda): Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Keywords: bert|gpt|language-model|natural-language-processing|natural-language-understanding|nlp|transformers