How do I create an Inference Endpoint with this model?

#22
by pdich2085 - opened

Hi all,
I am a newbie - so I would like to generate an inference Endpoint with this model, but everytime I try doing that I get an error saying that the repo doesn't have a "handler.py" file hence it won't work.
I know that I can create my own custom "handler.py" file, but when I do I get all sort of errors in the repo - mainly is because I am not sure how to include all other pytorch bin files that are needed in the repo.

Any help is highly appreciated.

Thank you.

Paulo

Salesforce org

Hi @pdich2085
A while back, @florentgbelidji made an endpoint using HF implementation here: https://huggingface.co/florentgbelidji/blip_vqa/tree/main
Can you adapt it to use the image captioning model and let us know how it goes?

Sign up or log in to comment