Question: How many characters are accepted as input of the language model?
Answer: input byte embedding matrix has dimensionality 256