Update README.md
Browse files
README.md
CHANGED
|
@@ -74,7 +74,7 @@ For more information about the pipeline parameters, please refer to [here](https
|
|
| 74 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 75 |
|
| 76 |
```shell
|
| 77 |
-
lmdeploy serve api_server OpenGVLab/InternVL2-Llama3-76B-AWQ --
|
| 78 |
```
|
| 79 |
|
| 80 |
To use the OpenAI-style interface, you need to install OpenAI:
|
|
|
|
| 74 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 75 |
|
| 76 |
```shell
|
| 77 |
+
lmdeploy serve api_server OpenGVLab/InternVL2-Llama3-76B-AWQ --server-port 23333 --model-format awq
|
| 78 |
```
|
| 79 |
|
| 80 |
To use the OpenAI-style interface, you need to install OpenAI:
|