Does the model supported Thai language?

#4
by new5558 - opened

Thank you for the decision to open source this model. I am Thai speaker and there are not many models that support our languages. Although It is stated on the model card that Thai is one of the supported languages, I cannot find any trace of Thai character inside tokenizer.json.

Is there anything I missed to run inference in Thai?

Did you happen to find any answer ? I am looking same for some other language

new5558 changed discussion status to closed

Sadly, I think multilingual mentioned in the model card may be a mistake since that is only alphabet character in tokenizer.json file

Sign up or log in to comment