Is TGI possible?
#3
by
RonanMcGovern
- opened
Text Generation Inference
idefics2 integration into tgi is on our current todo! stay tuned!
Great thanks
VictorSanh
changed discussion status to
closed
I don't see a PR on text-generation-inference on this. Is there any discussion or PR I can follow for updates? Thanks @VictorSanh
It lives on tgi main since earlier this week!
it is now part of an official pypi release!
https://github.com/huggingface/text-generation-inference/releases/tag/v2.0.2
really nice, I'll be trying this out very soon