Before revision:  We suggest metrics to evaluate tokenizers and extensive model-independent analyses demonstrate the efficacy of the encoding when used together with data-driven subword tokenizers  .
After revision:  We suggest metrics to evaluate tokenizers and extensive model-independent analyses demonstrate the efficacy of the encoding when used together with data-driven subword tokenizers . Since there has been no prior work on quantitatively evaluating vocabulary efficiency, we propose metrics to do so .