How to set the temperature

#25
by aakash1307 - opened

I am slightly new to the LLAVA ecosystem so wanted to check how to set the temperature. In the documentation, I can't find any parameter similar to temperature so wanted to confirm how to set it or the model ensures the output is same for a certain image?

Llava Hugging Face org

Hi, you can just pass the temperature argument to the generate method. See here for more details: https://huggingface.co/docs/transformers/v4.40.1/en/generation_strategies.

Sign up or log in to comment