llava-hf

/

llava-1.5-7b-hf

like 121

Hi, passing do_sample = False disables top-k sampling, not beam search. See this blog post which explains all the details. Beam search can be enabled by passing the num_beams argument.

However, looking at the original code, it looks like they use sampling with a temperature of 0.2. cc @ybelkada

Hi @floschne !
I second what niels said, you can do it manually for Llava as it should work out of the box! We just set it to False in order to get reproducible results in the demo