Hansimov commited on
Commit
acbd8bf
1 Parent(s): 6d3fdc0

:pencil: [Doc] Update available models

Browse files
Files changed (1) hide show
  1. README.md +3 -12
README.md CHANGED
@@ -12,24 +12,15 @@ Huggingface LLM Inference API in OpenAI message format.
12
 
13
  ## Features
14
 
15
- Implemented:
16
-
17
- - Available Models:
18
- - `mixtral-8x7b`, `mistral-7b`, `openchat-3.5`
19
  - Adaptive prompt templates for different models
20
  - Support OpenAI API format
21
- - Can use api endpoint via official `openai-python` package
22
  - Support both stream and no-stream response
23
  - Support API Key via both HTTP auth header and env varible (https://github.com/Hansimov/hf-llm-api/issues/4)
24
  - Docker deployment
25
 
26
- 🔨 In progress:
27
- - [ ] Support more models (https://github.com/Hansimov/hf-llm-api/issues/5)
28
- - [ ] meta-llama/Llama-2-70b-chat-hf
29
- - [ ] codellama/CodeLlama-34b-Instruct-hf
30
- - [ ] tiiuae/falcon-180B-chat
31
-
32
-
33
  ## Run API service
34
 
35
  ### Run in Command Line
 
12
 
13
  ## Features
14
 
15
+ - Available Models (2024/01/15): (https://github.com/Hansimov/hf-llm-api/issues/5)
16
+ - `mixtral-8x7b`, `mistral-7b`
 
 
17
  - Adaptive prompt templates for different models
18
  - Support OpenAI API format
19
+ - Enable api endpoint via official `openai-python` package
20
  - Support both stream and no-stream response
21
  - Support API Key via both HTTP auth header and env varible (https://github.com/Hansimov/hf-llm-api/issues/4)
22
  - Docker deployment
23
 
 
 
 
 
 
 
 
24
  ## Run API service
25
 
26
  ### Run in Command Line