What tokenizer to use for Cantonese?

#1
by jevenzh - opened

Hi Wayne,

As Cantonese is not in the Whisper's official list of supported languages, what tokenizer did you use to train this model?

Thanks,
Jeven

Sign up or log in to comment