File size: 637 Bytes
8b28372 f8febce d637758 8b28372 f8febce c1a7f6f 0a89331 6612212 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: cc-by-nc-4.0
library_name: gguf
pipeline_tag: sentence-similarity
---
GGUF quants for https://huggingface.co/Salesforce/SFR-Embedding-Mistral
NOTE: This is a text embedding model used for feature extraction.
As of Feb. 9, 2024 this model is no. 1 on the MTEB leaderboard.
https://huggingface.co/spaces/mteb/leaderboard
I have an example of how to use llama.cpp to generate embeddings for sentence similarity on my repo:
https://github.com/dranger003/llama.cpp-dotnet
| Layers | Context | Template |
| --- | --- | --- |
| <pre>32</pre> | <pre>32768</pre> | <pre>Instruct: {task_description}<br>Query: {query}</pre> | |