T5 special character tokenization

#2
by Batufanoo - opened

Can I get information about how Turkish characters such as ı, ğ, İ are added to the t5 tokenizer?

Sign up or log in to comment