Test model.
Hello. We want to try out this model. But I'm having a hard time deploying it anywhere. I barely made it work in a notebook.
We are happy to purchase a license for it .
Can you point out what is the best way to deploy it?
Howdy @ZallesovAlex
what notebook did you try?
Did you try out the model recommended on the Model description page?
https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharingWhat is your goal? Are you just trying to get this working as a server side api? You may find these instructions for tgi helpful setting up functions with tgi, and chat-ui.
Hello @RonanMcGovern , I have recently sent you an email regarding the purchase of a license. Could you kindly keep an eye out for it? Thank you!
Hi @palloo , I just replied! In future, feel free to directly post your questions here by creating a new post/thread under Community. Cheers, Ronan