Minimum number of tokens in generate

#38
by rachith - opened

To avoid duplication, please see here: and https://discuss.huggingface.co/t/minimum-number-of-tokens-in-generate/33481?u=rachith

In essence, I think min_new_tokens in model.generate() doesnt do what its supposed to it and it seems like a general issue not restricted to flant5? Or is it?

Sign up or log in to comment