Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Poor performance with idefics-9b-instruct?
#45
by
alfredcs
- opened
Not 100% sure if this is true but the idefics-9b-instruct's performance seems to be worst than suboptimal. It mistakes the 1st sample image (i.e. Barack Obama) as someone else and hallucinates. It was deployed using tgi1.0.3 on local and the language only seems to be OK.
You can try to play with the generation parameters (greedy vs sampling). Usually greedy gives more accurate answers
You can try to play with the generation parameters (greedy vs sampling). Usually greedy gives more accurate answers
It took a few shots with hints (i.e. a former president) for the model to recognize correctly.