Spaces:

Hansimov
/

hf-llm-api

Running

App Files Files Community

hf-llm-api / apis /chat_api.py

Commit History

:gem: [Feature] Support call hf api with api_key via HTTP Bearer

2da6968

Hansimov commited on Dec 28, 2023

:gem: [Feature] Support no-stream mode with dict response

d2b20f2

Hansimov commited on Dec 27, 2023

:boom: [Fix] Suppress ping message by increasing ping interval

489b65b

Hansimov commited on Dec 26, 2023

:zap: [Enhance] New models: mistral-7b and openchat-3.5

e916990

Hansimov commited on Dec 20, 2023

:zap: [Enhance] Default models and max_new_tokens

6aa8b86

Hansimov commited on Dec 20, 2023

:gem: [Feature] New ArgParser: Specify server ip, port and running mode

e28221f

Hansimov commited on Dec 19, 2023

:gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call

3a09006

Hansimov commited on Dec 19, 2023