michaelfeil
commited on
Commit
•
7080912
1
Parent(s):
3262835
Update README.md
Browse files
README.md
CHANGED
@@ -3054,7 +3054,7 @@ console.log(similarities); // [0.15664823859882132, 0.24481869975470627]
|
|
3054 |
OpenAI compatible API deployment with [Infinity](https://github.com/michaelfeil/infinity) and Docker.
|
3055 |
|
3056 |
```bash
|
3057 |
-
docker run --gpus all -v $PWD/data:/app/.cache -
|
3058 |
michaelf34/infinity:0.0.70 \
|
3059 |
v2 --model-id Snowflake/snowflake-arctic-embed-m --dtype float16 --batch-size 32 --engine torch --port 7997
|
3060 |
```
|
|
|
3054 |
OpenAI compatible API deployment with [Infinity](https://github.com/michaelfeil/infinity) and Docker.
|
3055 |
|
3056 |
```bash
|
3057 |
+
docker run --gpus all -v $PWD/data:/app/.cache -p "7997":"7997" \
|
3058 |
michaelf34/infinity:0.0.70 \
|
3059 |
v2 --model-id Snowflake/snowflake-arctic-embed-m --dtype float16 --batch-size 32 --engine torch --port 7997
|
3060 |
```
|