inference_params

#12
by DataSoul - opened

Do you have any recommended settings, deepseek coder is indeed very useful, but I haven't seen that in the Model card.
just like: top_k, top_p , temp, repeat_penalty

DeepSeek org

top_k=50, top_p=0.95 , temp=0.2, repeat_penalty=1

Sign up or log in to comment