流式输出支持

#16

by zhenghui - opened Jul 17, 2023

Jul 17, 2023

This comment has been hidden

Jul 21, 2023

本身就支持流式输出
设置 stream = True即可
model.chat(tokenizer, messages, stream=True)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment