Upload sentence-transformers/all-MiniLM-L6-v2 ctranslate fp16 weights

README.md

@@ -38,21 +38,11 @@ Speedup inference while reducing memory by 2x-4x using int8 inference in C++ on
 
 quantized version of [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2)
 ```bash
-pip install hf-hub-ctranslate2>=2.0.8 ctranslate2>=3.16.0
-```
-Converted on 2023-06-15 using
-```
-ct2-transformers-converter --model sentence-transformers/all-MiniLM-L6-v2 --output_dir ~/tmp-ct2fast-all-MiniLM-L6-v2 --force --copy_files config_sentence_transformers.json tokenizer.json modules.json README.md tokenizer_config.json sentence_bert_config.json data_config.json vocab.txt special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
+pip install hf-hub-ctranslate2>=2.10.0 ctranslate2>=3.16.0
 ```
 
-Checkpoint compatible to [ctranslate2>=3.16.0](https://github.com/OpenNMT/CTranslate2)
-and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
-- `compute_type=int8_float16` for `device="cuda"`
-- `compute_type=int8`  for `device="cpu"`
-
 ```python
-from transformers import AutoTokenizer
-
+# from transformers import AutoTokenizer
 model_name = "michaelfeil/ct2fast-all-MiniLM-L6-v2"
 
 from hf_hub_ctranslate2 import EncoderCT2fromHfHub
@@ -63,10 +53,25 @@ model = EncoderCT2fromHfHub(
         compute_type="float16",
         # tokenizer=AutoTokenizer.from_pretrained("{ORG}/{NAME}")
 )
-outputs = model.generate(
-    text=["I like soccer", "I like tennis", "The eiffel tower is in Paris"],
+embeddings = model.encode(
+    ["I like soccer", "I like tennis", "The eiffel tower is in Paris"],
+    batch_size=32,
+    convert_to_numpy=True,
+    normalize_embeddings=True,
 )
-print(outputs.shape, outputs)
+print(embeddings.shape, embeddings)
+scores = (embeddings @ embeddings.T) * 100
+
+```
+
+Checkpoint compatible to [ctranslate2>=3.16.0](https://github.com/OpenNMT/CTranslate2)
+and [hf-hub-ctranslate2>=2.10.0](https://github.com/michaelfeil/hf-hub-ctranslate2)
+- `compute_type=int8_float16` for `device="cuda"`
+- `compute_type=int8`  for `device="cpu"`
+
+Converted on 2023-06-16 using
+```
+ct2-transformers-converter --model sentence-transformers/all-MiniLM-L6-v2 --output_dir ~/tmp-ct2fast-all-MiniLM-L6-v2 --force --copy_files config_sentence_transformers.json tokenizer.json modules.json README.md tokenizer_config.json sentence_bert_config.json data_config.json vocab.txt special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
 ```
 
 # Licence and other remarks: