How to make the text longer?

#2
by hiddenchamp - opened

The code works fine but I have a big problem. It makes the paraphrased text really short. For example the original text is two sentences long and 50 characters. The paraphrased version is 1 sentence long and only 25-30 characters.

How can I make sure the output is longer?
Also what is num_beams = 10? I tried playing a bit with the number but I don't see much difference.

Thank you.

The length of the output of the model actually depends on pretraining. It depends on the number of tokens you select while training.
You can look at this blog by Patrick von Platen to understand how num_beams in beam search works. https://huggingface.co/blog/how-to-generate#beam-search

Sign up or log in to comment