hf-llm-api / apis

Commit History

:gem: [Feature] Support no-stream mode with dict response
d2b20f2

Hansimov commited on

:boom: [Fix] Suppress ping message by increasing ping interval
489b65b

Hansimov commited on

:zap: [Enhance] New models: mistral-7b and openchat-3.5
e916990

Hansimov commited on

:zap: [Enhance] Default models and max_new_tokens
6aa8b86

Hansimov commited on

:gem: [Feature] New ArgParser: Specify server ip, port and running mode
e28221f

Hansimov commited on

:gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call
3a09006

Hansimov commited on