Alibaba-NLP
/

gte-Qwen2-1.5B-instruct

Sentence Similarity

sentence-transformers

text-generation

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

michaelfeil commited on 10 days ago

Commit

13661f9

•

1 Parent(s): 31e97fe

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5627,7 +5627,7 @@ Usage via [infinity, MIT Licensed](https://github.com/michaelfeil/infinity).
 docker run \
 --gpus "0" -p "7997":"7997" \
 michaelf34/infinity:0.0.68-trt-onnx \
-v2 --model-id Alibaba-NLP/gte-Qwen2-1.5B-instruct --revision "refs/pr/20" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997
 ```
 ## Evaluation

 docker run \
 --gpus "0" -p "7997":"7997" \
 michaelf34/infinity:0.0.68-trt-onnx \
+v2 --model-id Alibaba-NLP/gte-Qwen2-1.5B-instruct --revision "refs/pr/20" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
 ```
 ## Evaluation