Maximum Output Length for this fine-tuned model

#6
by ja4h3ad - opened

Hello - can you please tell me how to adjust the maximum output length for the model summaries?

you can control it by giving it as an argument. however there is a limit and the model has been done on 1:10 compression. If you want more compression, then using this directly will affect the sentence completion. slight retuning is required.

knkarthick changed discussion status to closed

Can you clarify where this can be gieven as an argument? Is it on on summarizer instantiation? Thanks

This warning shows up, upon setting max and min length
"UserWarning: Unfeasible length constraints: min_length (6000) is larger than the maximum possible length (62). Generation will stop at the defined maximum length. You should decrease the minimum length and/or increase the maximum length. Note that max_length is set to 62, its default value."

Did you cap the length to be 62 and how can we increase this number?
Thanks

Sign up or log in to comment