Inference via TGI

by abrakaa - opened May 22

May 22

Thanks for your work on this! Is inference via HF's TGI supported on this model?

Microsoft org May 22

It is not supported by HF's TGI now.

nguyenbh changed discussion status to closed May 23

May 28

Will inference via TGI be supported in the near future ?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment