michaelfeil commited on
Commit
1ef9639
1 Parent(s): 2aa5579

Update infinity example

Browse files

Added

### infinity_emb

Usage via [infinity, MIT Licensed](https://github.com/michaelfeil/infinity).

```bash
docker run \
--gpus "0" -p "7997":"7997" \
michaelf34/infinity:latest \
v2 --model-id dunzhang/stella_en_400M_v5 --revision "main" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
```

# FAQ

Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -5579,6 +5579,17 @@ print(similarities)
5579
  # [0.32818374 0.80954516]]
5580
  ```
5581
 
 
 
 
 
 
 
 
 
 
 
 
5582
  # FAQ
5583
 
5584
  Q: The details of training?
 
5579
  # [0.32818374 0.80954516]]
5580
  ```
5581
 
5582
+ ### infinity_emb
5583
+
5584
+ Usage via [infinity, MIT Licensed](https://github.com/michaelfeil/infinity).
5585
+
5586
+ ```bash
5587
+ docker run \
5588
+ --gpus "0" -p "7997":"7997" \
5589
+ michaelf34/infinity:latest \
5590
+ v2 --model-id dunzhang/stella_en_400M_v5 --revision "main" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
5591
+ ```
5592
+
5593
  # FAQ
5594
 
5595
  Q: The details of training?