GitHub repository: petergoldstein/tokenizers-ruby
Primary language: Ruby
Description: Fast state-of-the-art tokenizers for Ruby