top_p_max_val

#21
by HugoLaurencon HF staff - opened

There is a bug with top p = 1 (thanks @lewtun ), so setting the max value to 0.99.

HuggingFaceM4 org

Note that you also need to bound top_p > 0 to avoid validation errors - sorry for not mentioning that before

HuggingFaceM4 org

Ok thanks!

HugoLaurencon changed pull request status to open
VictorSanh changed pull request status to merged

Sign up or log in to comment