Spaces:
Duplicated from Hansimov/hf-llm-api

radinhas
/

hf-llm-api

Running

App Files Files Community

hf-llm-api / networks /message_streamer.py

Commit History

:zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug

047008b

Hansimov commited on Dec 20, 2023

:pencil: [Comment] References of requests params

395ee29

Hansimov commited on Dec 20, 2023

:zap: [Enhance] Default models and max_new_tokens

6aa8b86

Hansimov commited on Dec 20, 2023

:zap: [Enhance] API: Ensure temperature to be positive

3dfcb72

Hansimov commited on Dec 19, 2023

:gem: [Feature] New ArgParser: Specify server ip, port and running mode

e28221f

Hansimov commited on Dec 19, 2023

:gem: [Feature] New MessageStreamer: Enable requests inference api with requests

9f341cc

Hansimov commited on Dec 19, 2023