GitHub repository: nlpodyssey/gotokenizers
Primary language: Go
Description: GO implementation of today's most used tokenizers