Hugging Face's logo

Spaces:
tianlong12
/
hf-llm-api
Runtime error

App Files Community
hf-llm-api

Commit History

:pencil: [Doc] Readme: Fix typo of gpt-3.5-turbo, and update docker tag
ed5e0c7

Hansimov commited on

:boom: [Fix] Actions failed if tag new release during run
9a70585

Hansimov commited on

:pencil: [Config] Upgrade to v1.1.3
a3b9751

Hansimov commited on

:gem: [Feature] Enable non-stream return, and prettify logger
397529a

Hansimov commited on

:boom: [Fix] Set default model
5dc8ebf

Hansimov commited on

:boom: [Fix] Push to remote main branch if tagged release
5a11ed7

Hansimov commited on

:pencil: [Doc] Readme: New model and shields badge, and upgrade to v1.1.1
0edea2e

Hansimov commited on

:recycle: [Refactor] Rename gpt-3.5 to gpt-3.5-turbo
d36d623

Hansimov commited on

:pencil: [Config] Enable cache in docker, and monitor more files in actions
246eab5

Hansimov commited on

:pencil: [Config] Release v1.1
9ee1d9a

Hansimov commited on

:gem: [Feature] Enable gpt-3.5 in chat_api
cd6b52a

Hansimov commited on

:recycle: [Refactor] Rename message_streamer to huggingface_streamer
3125c87

Hansimov commited on

:recycle: [Refactor] Configure api info with config.json
deca16d

Hansimov commited on

:pencil: [CI] Trigger sync actions only when new version released
d7e9766

Hansimov commited on

:gem: [Feature] Support multiple messages for gpt-3.5 model, and refactor proxies
9d28f7e

Hansimov commited on

:recycle: [Refactor] Use tclogger, and configure envs better
babcd78

Hansimov commited on

:gem: [Feature] Enable stream output of chat completions
03712cd

Hansimov commited on

:gem: [Feature] Enable conversation with openai
bee1f65

Hansimov commited on

:hammer: [WIP] Try to enable conversation api
1e3a144

Hansimov commited on

:zap: [Enhance] Handle if http_proxy is None, and prettify logs
f3e7da4

Hansimov commited on

:gem: [Feature] New api for chat_requiements, and moduralize logs
1ee4f76

Hansimov commited on

:recycle: [Refactor] Prettify initializaiton of OpenaiAPI requests params
96d1023

Hansimov commited on

:gem: [Feature] Enable get models of chat.openai.com
51e07f2

Hansimov commited on

:boom: [Fix] Revert chat templates with mannual version as nous-mixtral-8x7b behaves weirdly
dc3b7a9

Hansimov commited on

:recycle: [Refactor] Use official chat_template to replace mannual parses for several models, and remove unused message split functions
4a9e46f

Hansimov commited on

:boom: [Fix] [Errno 13] Permission denied: '/.cache'
e491840

Hansimov commited on

:recycle: [Refactor] Move AVAILABLE_MODELS(_DICTS) to constants
40ba0ea

Hansimov commited on

:recycle: [Refactor] Move STOP_SEQUENCES_MAP and TOKEN_LIMIT_MAP to constants
bf8c5bd

Hansimov commited on

:recycle: [Refactor] Move MODELS_MAP to constants
3f608c6

Hansimov commited on

:gem: [Feature] Support new model: openchat-3.5-0106
9f5d69c

Hansimov commited on

:gem: [Feature] New model enabled: gemma-7b
77b5a47

Hansimov commited on

:hammer: [Test] Enable deployment in vercel
fdc9940

Hansimov commited on

:zap: [Enhance] Set min and max for top_p
64645f0

Hansimov commited on

:gem: [Feature] Add top_p and set 0.95 as default
403b8cf

Hansimov commited on

:gem: [Feature] Add use_cache parameter, and set default temperature to 0.5
e2b245b

Hansimov commited on

:boom: [Fix] Missing system message for original mistral models
395e196

Hansimov commited on

:zap: [Enhance] Display schema of /api/v1 for user-friendly compatibility
a2d3414

Hansimov commited on

:gem: [Feature] ChatAPIApp: New /readme route
6e2fad5

Hansimov commited on

:pencil: [Doc] New model, and prettify formats
37be019

Hansimov commited on

:zap: [Enhance] ChatAPIApp: Only include schema for non-prefix route
06a233d

Hansimov commited on

:gem: [Feature] New model enabled: nous-mixtral-8-7b
4a28ca5

Hansimov commited on

:zap: [Enhance] Align /models response with openai format
245d9fd

Hansimov commited on

:pencil: [Doc] Update available models
acbd8bf

Hansimov commited on

:zap: [Enhance] add /api/v1 prefix for hf banning and ui compatability
6d3fdc0

Hansimov commited on

:zap: [Enhance] Remove openchat-3.5 from available models
06c8d58

Hansimov commited on

:boom: [Fix] inputs_tokens + max_new_tokens must <= 32768
fa3bfb0

Hansimov commited on

:boom: [Fix] temperature must be strictly positive
eb00725

Hansimov commited on

:boom: [Fix] Error 500 when temperature is null
8ba223c

Hansimov commited on

:boom: [Fix] Error 422 when max_tokens is null
a54e7a6

Hansimov commited on

:zap: [Enhance] Auto calculate max_tokens if not set
1b9f698

Hansimov commited on