how to generate response in stream?

#2
by amanoooo - opened

how to generate response in stream?

Fengshenbang-LM org

how to generate response in stream?

你可以使用类似vllm这样的推理引擎。

Sign up or log in to comment