GitHub repository: zouharvi/tokenization-scorer
Primary language: Python
Created: 2023-04-29T14:44:21Z
Description: Simple-to-use scoring function for arbitrarily tokenized texts.