Poor performance with idefics-9b-instruct?

#45
by alfredcs - opened

Not 100% sure if this is true but the idefics-9b-instruct's performance seems to be worst than suboptimal. It mistakes the 1st sample image (i.e. Barack Obama) as someone else and hallucinates. It was deployed using tgi1.0.3 on local and the language only seems to be OK.

You can try to play with the generation parameters (greedy vs sampling). Usually greedy gives more accurate answers

You can try to play with the generation parameters (greedy vs sampling). Usually greedy gives more accurate answers

It took a few shots with hints (i.e. a former president) for the model to recognize correctly.

Sign up or log in to comment