GitHub repository: mirandrom/py-bpe
Primary language: Python
Description: Pure python implementation of byte pair encoding (subword tokenization)