LDC tokenization ends at the last character