Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Dockerfile for the container serving the API https://api-inference.huggingface.co/models/HuggingFaceM4/idefics-80b
#44
by
alfredcs
- opened
Any plan to release the dockerfile or equivalent configuration details for API entry point https://api-inference.huggingface.co/models/HuggingFaceM4/idefics-80b?
@Narsil
, could you comment?
I see that a tgi release is about to happen. Am I correct in thinking that it will come with an updated docker image?
1.0.2 already supports idefics !
So using TGI with that tag should work out of the box.
It's not 100% optimized at the moment so keep updating as we might release more updates on speed (cannot make any promise though on timelines)
1.0.3 Was just released by the way.
Very cool! Thank you both! Got the Dockerfile from tgi @github.