Translation of longer texts
#13
by
hanshupe
- opened
It seems that only very short texts like 1 sentence are supported. I am wondering if I am missing something, or how would you use it to translate a few pages of texts?
Hello. You'd have to break the text into sentences, and translate the sentences individually.
I thought so too, but its not even able to translate one sentence but stops after like 10 words sometimes. Can you specify the max length? I am using Farsi as a source and English as target language.
You can set max_new_tokens to 512. https://huggingface.co/docs/transformers/llm_tutorial