Playground support idefics-9b-instruct?

#46
by chace42 - opened

Hi, guys. After review code, I found there are an API for 9b model: https://api-inference.huggingface.co/models/HuggingFaceM4/idefics-9b-instruct
But If I uncomment the code use this api directly, it just response with 404.
Can you support this API? or any document to guide to deploy this API locally.

HuggingFaceM4 org

Hi,
We use only the 80b version on the playground to make it simple, but this space is running the 9b-instruct version: https://huggingface.co/spaces/aliabid94/idefics_playground

9b-instruct version will raise exception as API is not available.

image.png

HuggingFaceM4 org

Ah yes indeed, it worked with the example images, but uploading your own image raises errors. Let me look into this

HuggingFaceM4 org

You would need to adapt the GRADIO_LINK in case you duplicate the space!

Sign up or log in to comment