Hugging Face's logo

Spaces:
uwnlp
/
guanaco-playground-tgi
Running

App Files Community
10

API

#8
by trnt - opened
Discussion
trnt

Can I ask this chatbot a question and get answers using the API? Form like this

client = Client("https://api-inference.huggingface.co/models/timdettmers/guanaco-33b-merged")
question = "What is Deep Learning?"
print(client.answer(question))

many thanks

xsa-dev

I could launch this with the help of LangChain. See my gist as example.

trnt

many thanks, @xsa-face
I followed the instructions and it works, but the result is not the same as using the UI. Sometimes the bot even gives the wrong answer, which has nothing to do with the question. Can you explain?

Sign up or log in to comment