Gradio Streaming Option

#2
by Venom717 - opened

does anyone know how to add the streaming feature (types the answer while generating) to this code
code :
def predict(message, history):
history_langchain_format = []
for human, ai in history:
history_langchain_format.append(HumanMessage(content=human))
history_langchain_format.append(AIMessage(content=ai))
history_langchain_format.append(HumanMessage(content=message))

gpt_response = qa({"question": message})

return gpt_response['answer']
Owner

Closing as unrelated with this repo.

Wauplin changed discussion status to closed

Sign up or log in to comment