{MODEL_NAME}
This is a sentence-transformers model: It maps sentences & paragraphs to a 1024 dimensional dense vector space and can be used for tasks like clustering or semantic search.
Usage (Sentence-Transformers)
Using this model becomes easy when you have sentence-transformers installed:
pip install -U sentence-transformers
Then you can use the model like this:
from sentence_transformers import SentenceTransformer
sentences = ["This is an example sentence", "Each sentence is converted"]
model = SentenceTransformer('{MODEL_NAME}')
embeddings = model.encode(sentences)
print(embeddings)
Usage (HuggingFace Transformers)
Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings.
from transformers import AutoTokenizer, AutoModel
import torch
#Mean Pooling - Take attention mask into account for correct averaging
def mean_pooling(model_output, attention_mask):
token_embeddings = model_output[0] #First element of model_output contains all token embeddings
input_mask_expanded = attention_mask.unsqueeze(-1).expand(token_embeddings.size()).float()
return torch.sum(token_embeddings * input_mask_expanded, 1) / torch.clamp(input_mask_expanded.sum(1), min=1e-9)
# Sentences we want sentence embeddings for
sentences = ['This is an example sentence', 'Each sentence is converted']
# Load model from HuggingFace Hub
tokenizer = AutoTokenizer.from_pretrained('{MODEL_NAME}')
model = AutoModel.from_pretrained('{MODEL_NAME}')
# Tokenize sentences
encoded_input = tokenizer(sentences, padding=True, truncation=True, return_tensors='pt')
# Compute token embeddings
with torch.no_grad():
model_output = model(**encoded_input)
# Perform pooling. In this case, mean pooling.
sentence_embeddings = mean_pooling(model_output, encoded_input['attention_mask'])
print("Sentence embeddings:")
print(sentence_embeddings)
- Downloads last month
- 4,370
Evaluation results
- map_at_1 on MTEB ArguAnatest set self-reported17.070
- map_at_10 on MTEB ArguAnatest set self-reported29.373
- map_at_100 on MTEB ArguAnatest set self-reported30.790
- map_at_1000 on MTEB ArguAnatest set self-reported30.820
- map_at_3 on MTEB ArguAnatest set self-reported24.395
- map_at_5 on MTEB ArguAnatest set self-reported27.137
- mrr_at_1 on MTEB ArguAnatest set self-reported17.923
- mrr_at_10 on MTEB ArguAnatest set self-reported29.695
- mrr_at_100 on MTEB ArguAnatest set self-reported31.098
- mrr_at_1000 on MTEB ArguAnatest set self-reported31.128
- mrr_at_3 on MTEB ArguAnatest set self-reported24.704
- mrr_at_5 on MTEB ArguAnatest set self-reported27.449
- ndcg_at_1 on MTEB ArguAnatest set self-reported17.070
- ndcg_at_10 on MTEB ArguAnatest set self-reported37.269
- ndcg_at_100 on MTEB ArguAnatest set self-reported43.716
- ndcg_at_1000 on MTEB ArguAnatest set self-reported44.531
- ndcg_at_3 on MTEB ArguAnatest set self-reported26.839
- ndcg_at_5 on MTEB ArguAnatest set self-reported31.845
- precision_at_1 on MTEB ArguAnatest set self-reported17.070
- precision_at_10 on MTEB ArguAnatest set self-reported6.302
- precision_at_100 on MTEB ArguAnatest set self-reported0.922
- precision_at_1000 on MTEB ArguAnatest set self-reported0.099
- precision_at_3 on MTEB ArguAnatest set self-reported11.309
- precision_at_5 on MTEB ArguAnatest set self-reported9.246
- recall_at_1 on MTEB ArguAnatest set self-reported17.070
- recall_at_10 on MTEB ArguAnatest set self-reported63.016
- recall_at_100 on MTEB ArguAnatest set self-reported92.248
- recall_at_1000 on MTEB ArguAnatest set self-reported98.720
- recall_at_3 on MTEB ArguAnatest set self-reported33.926
- recall_at_5 on MTEB ArguAnatest set self-reported46.230
- map on MTEB AskUbuntuDupQuestionstest set self-reported53.443
- mrr on MTEB AskUbuntuDupQuestionstest set self-reported66.547
- cos_sim_pearson on MTEB BIOSSEStest set self-reported75.965
- cos_sim_spearman on MTEB BIOSSEStest set self-reported73.966
- euclidean_pearson on MTEB BIOSSEStest set self-reported75.685
- euclidean_spearman on MTEB BIOSSEStest set self-reported74.594
- manhattan_pearson on MTEB BIOSSEStest set self-reported75.950
- manhattan_spearman on MTEB BIOSSEStest set self-reported74.722
- map_at_1 on MTEB CQADupstackAndroidRetrievaltest set self-reported14.119
- map_at_10 on MTEB CQADupstackAndroidRetrievaltest set self-reported19.661
- map_at_100 on MTEB CQADupstackAndroidRetrievaltest set self-reported20.706
- map_at_1000 on MTEB CQADupstackAndroidRetrievaltest set self-reported20.848
- map_at_3 on MTEB CQADupstackAndroidRetrievaltest set self-reported17.759
- map_at_5 on MTEB CQADupstackAndroidRetrievaltest set self-reported18.645
- mrr_at_1 on MTEB CQADupstackAndroidRetrievaltest set self-reported17.167
- mrr_at_10 on MTEB CQADupstackAndroidRetrievaltest set self-reported23.313
- mrr_at_100 on MTEB CQADupstackAndroidRetrievaltest set self-reported24.263
- mrr_at_1000 on MTEB CQADupstackAndroidRetrievaltest set self-reported24.353
- mrr_at_3 on MTEB CQADupstackAndroidRetrievaltest set self-reported21.412
- mrr_at_5 on MTEB CQADupstackAndroidRetrievaltest set self-reported22.313
- ndcg_at_1 on MTEB CQADupstackAndroidRetrievaltest set self-reported17.167
- ndcg_at_10 on MTEB CQADupstackAndroidRetrievaltest set self-reported23.631
- ndcg_at_100 on MTEB CQADupstackAndroidRetrievaltest set self-reported28.427
- ndcg_at_1000 on MTEB CQADupstackAndroidRetrievaltest set self-reported31.862
- ndcg_at_3 on MTEB CQADupstackAndroidRetrievaltest set self-reported20.175
- ndcg_at_5 on MTEB CQADupstackAndroidRetrievaltest set self-reported21.397
- precision_at_1 on MTEB CQADupstackAndroidRetrievaltest set self-reported17.167
- precision_at_10 on MTEB CQADupstackAndroidRetrievaltest set self-reported4.549
- precision_at_100 on MTEB CQADupstackAndroidRetrievaltest set self-reported0.837
- precision_at_1000 on MTEB CQADupstackAndroidRetrievaltest set self-reported0.136
- precision_at_3 on MTEB CQADupstackAndroidRetrievaltest set self-reported9.680
- precision_at_5 on MTEB CQADupstackAndroidRetrievaltest set self-reported6.981
- recall_at_1 on MTEB CQADupstackAndroidRetrievaltest set self-reported14.119
- recall_at_10 on MTEB CQADupstackAndroidRetrievaltest set self-reported32.148
- recall_at_100 on MTEB CQADupstackAndroidRetrievaltest set self-reported52.740
- recall_at_1000 on MTEB CQADupstackAndroidRetrievaltest set self-reported76.670
- recall_at_3 on MTEB CQADupstackAndroidRetrievaltest set self-reported22.019
- recall_at_5 on MTEB CQADupstackAndroidRetrievaltest set self-reported25.361
- map_at_1 on MTEB CQADupstackEnglishRetrievaltest set self-reported16.576
- map_at_10 on MTEB CQADupstackEnglishRetrievaltest set self-reported22.281
- map_at_100 on MTEB CQADupstackEnglishRetrievaltest set self-reported23.066
- map_at_1000 on MTEB CQADupstackEnglishRetrievaltest set self-reported23.166
- map_at_3 on MTEB CQADupstackEnglishRetrievaltest set self-reported20.385
- map_at_5 on MTEB CQADupstackEnglishRetrievaltest set self-reported21.557
- mrr_at_1 on MTEB CQADupstackEnglishRetrievaltest set self-reported20.892
- mrr_at_10 on MTEB CQADupstackEnglishRetrievaltest set self-reported26.605
- mrr_at_100 on MTEB CQADupstackEnglishRetrievaltest set self-reported27.229
- mrr_at_1000 on MTEB CQADupstackEnglishRetrievaltest set self-reported27.296
- mrr_at_3 on MTEB CQADupstackEnglishRetrievaltest set self-reported24.809
- mrr_at_5 on MTEB CQADupstackEnglishRetrievaltest set self-reported25.927
- ndcg_at_1 on MTEB CQADupstackEnglishRetrievaltest set self-reported20.892
- ndcg_at_10 on MTEB CQADupstackEnglishRetrievaltest set self-reported26.092
- ndcg_at_100 on MTEB CQADupstackEnglishRetrievaltest set self-reported29.399
- ndcg_at_1000 on MTEB CQADupstackEnglishRetrievaltest set self-reported31.884
- ndcg_at_3 on MTEB CQADupstackEnglishRetrievaltest set self-reported23.032
- ndcg_at_5 on MTEB CQADupstackEnglishRetrievaltest set self-reported24.634
- precision_at_1 on MTEB CQADupstackEnglishRetrievaltest set self-reported20.892
- precision_at_10 on MTEB CQADupstackEnglishRetrievaltest set self-reported4.885
- precision_at_100 on MTEB CQADupstackEnglishRetrievaltest set self-reported0.818
- precision_at_1000 on MTEB CQADupstackEnglishRetrievaltest set self-reported0.126
- precision_at_3 on MTEB CQADupstackEnglishRetrievaltest set self-reported10.977
- precision_at_5 on MTEB CQADupstackEnglishRetrievaltest set self-reported8.013
- recall_at_1 on MTEB CQADupstackEnglishRetrievaltest set self-reported16.576
- recall_at_10 on MTEB CQADupstackEnglishRetrievaltest set self-reported32.945
- recall_at_100 on MTEB CQADupstackEnglishRetrievaltest set self-reported47.337
- recall_at_1000 on MTEB CQADupstackEnglishRetrievaltest set self-reported64.592
- recall_at_3 on MTEB CQADupstackEnglishRetrievaltest set self-reported24.053
- recall_at_5 on MTEB CQADupstackEnglishRetrievaltest set self-reported28.465
- map_at_1 on MTEB CQADupstackGamingRetrievaltest set self-reported20.604
- map_at_10 on MTEB CQADupstackGamingRetrievaltest set self-reported28.755
- map_at_100 on MTEB CQADupstackGamingRetrievaltest set self-reported29.767
- map_at_1000 on MTEB CQADupstackGamingRetrievaltest set self-reported29.852
- map_at_3 on MTEB CQADupstackGamingRetrievaltest set self-reported26.268
- map_at_5 on MTEB CQADupstackGamingRetrievaltest set self-reported27.559
- mrr_at_1 on MTEB CQADupstackGamingRetrievaltest set self-reported24.326
- mrr_at_10 on MTEB CQADupstackGamingRetrievaltest set self-reported31.602
- mrr_at_100 on MTEB CQADupstackGamingRetrievaltest set self-reported32.460
- mrr_at_1000 on MTEB CQADupstackGamingRetrievaltest set self-reported32.521
- mrr_at_3 on MTEB CQADupstackGamingRetrievaltest set self-reported29.415
- mrr_at_5 on MTEB CQADupstackGamingRetrievaltest set self-reported30.581
- ndcg_at_1 on MTEB CQADupstackGamingRetrievaltest set self-reported24.326
- ndcg_at_10 on MTEB CQADupstackGamingRetrievaltest set self-reported33.335
- ndcg_at_100 on MTEB CQADupstackGamingRetrievaltest set self-reported38.086
- ndcg_at_1000 on MTEB CQADupstackGamingRetrievaltest set self-reported40.319
- ndcg_at_3 on MTEB CQADupstackGamingRetrievaltest set self-reported28.796
- ndcg_at_5 on MTEB CQADupstackGamingRetrievaltest set self-reported30.759
- precision_at_1 on MTEB CQADupstackGamingRetrievaltest set self-reported24.326
- precision_at_10 on MTEB CQADupstackGamingRetrievaltest set self-reported5.712
- precision_at_100 on MTEB CQADupstackGamingRetrievaltest set self-reported0.893
- precision_at_1000 on MTEB CQADupstackGamingRetrievaltest set self-reported0.115
- precision_at_3 on MTEB CQADupstackGamingRetrievaltest set self-reported13.208
- precision_at_5 on MTEB CQADupstackGamingRetrievaltest set self-reported9.329
- recall_at_1 on MTEB CQADupstackGamingRetrievaltest set self-reported20.604
- recall_at_10 on MTEB CQADupstackGamingRetrievaltest set self-reported44.505
- recall_at_100 on MTEB CQADupstackGamingRetrievaltest set self-reported65.866
- recall_at_1000 on MTEB CQADupstackGamingRetrievaltest set self-reported82.618
- recall_at_3 on MTEB CQADupstackGamingRetrievaltest set self-reported31.794
- recall_at_5 on MTEB CQADupstackGamingRetrievaltest set self-reported36.831
- map_at_1 on MTEB CQADupstackGisRetrievaltest set self-reported8.281
- map_at_10 on MTEB CQADupstackGisRetrievaltest set self-reported11.636
- map_at_100 on MTEB CQADupstackGisRetrievaltest set self-reported12.363
- map_at_1000 on MTEB CQADupstackGisRetrievaltest set self-reported12.469
- map_at_3 on MTEB CQADupstackGisRetrievaltest set self-reported10.415
- map_at_5 on MTEB CQADupstackGisRetrievaltest set self-reported11.144
- mrr_at_1 on MTEB CQADupstackGisRetrievaltest set self-reported9.266
- mrr_at_10 on MTEB CQADupstackGisRetrievaltest set self-reported12.838
- mrr_at_100 on MTEB CQADupstackGisRetrievaltest set self-reported13.609
- mrr_at_1000 on MTEB CQADupstackGisRetrievaltest set self-reported13.701
- mrr_at_3 on MTEB CQADupstackGisRetrievaltest set self-reported11.507
- mrr_at_5 on MTEB CQADupstackGisRetrievaltest set self-reported12.343
- ndcg_at_1 on MTEB CQADupstackGisRetrievaltest set self-reported9.266
- ndcg_at_10 on MTEB CQADupstackGisRetrievaltest set self-reported13.877
- ndcg_at_100 on MTEB CQADupstackGisRetrievaltest set self-reported18.119
- ndcg_at_1000 on MTEB CQADupstackGisRetrievaltest set self-reported21.247
- ndcg_at_3 on MTEB CQADupstackGisRetrievaltest set self-reported11.377
- ndcg_at_5 on MTEB CQADupstackGisRetrievaltest set self-reported12.675
- precision_at_1 on MTEB CQADupstackGisRetrievaltest set self-reported9.266
- precision_at_10 on MTEB CQADupstackGisRetrievaltest set self-reported2.226
- precision_at_100 on MTEB CQADupstackGisRetrievaltest set self-reported0.472
- precision_at_1000 on MTEB CQADupstackGisRetrievaltest set self-reported0.077
- precision_at_3 on MTEB CQADupstackGisRetrievaltest set self-reported4.859
- precision_at_5 on MTEB CQADupstackGisRetrievaltest set self-reported3.638
- recall_at_1 on MTEB CQADupstackGisRetrievaltest set self-reported8.281
- recall_at_10 on MTEB CQADupstackGisRetrievaltest set self-reported19.873
- recall_at_100 on MTEB CQADupstackGisRetrievaltest set self-reported40.585
- recall_at_1000 on MTEB CQADupstackGisRetrievaltest set self-reported65.225
- recall_at_3 on MTEB CQADupstackGisRetrievaltest set self-reported13.014
- recall_at_5 on MTEB CQADupstackGisRetrievaltest set self-reported16.147
- map_at_1 on MTEB CQADupstackMathematicaRetrievaltest set self-reported4.121
- map_at_10 on MTEB CQADupstackMathematicaRetrievaltest set self-reported7.272
- map_at_100 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.079
- map_at_1000 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.199
- map_at_3 on MTEB CQADupstackMathematicaRetrievaltest set self-reported6.212
- map_at_5 on MTEB CQADupstackMathematicaRetrievaltest set self-reported6.736
- mrr_at_1 on MTEB CQADupstackMathematicaRetrievaltest set self-reported5.721
- mrr_at_10 on MTEB CQADupstackMathematicaRetrievaltest set self-reported9.418
- mrr_at_100 on MTEB CQADupstackMathematicaRetrievaltest set self-reported10.281
- mrr_at_1000 on MTEB CQADupstackMathematicaRetrievaltest set self-reported10.385
- mrr_at_3 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.126
- mrr_at_5 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.779
- ndcg_at_1 on MTEB CQADupstackMathematicaRetrievaltest set self-reported5.721
- ndcg_at_10 on MTEB CQADupstackMathematicaRetrievaltest set self-reported9.673
- ndcg_at_100 on MTEB CQADupstackMathematicaRetrievaltest set self-reported13.853
- ndcg_at_1000 on MTEB CQADupstackMathematicaRetrievaltest set self-reported17.547
- ndcg_at_3 on MTEB CQADupstackMathematicaRetrievaltest set self-reported7.509
- ndcg_at_5 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.373
- precision_at_1 on MTEB CQADupstackMathematicaRetrievaltest set self-reported5.721
- precision_at_10 on MTEB CQADupstackMathematicaRetrievaltest set self-reported2.040
- precision_at_100 on MTEB CQADupstackMathematicaRetrievaltest set self-reported0.480
- precision_at_1000 on MTEB CQADupstackMathematicaRetrievaltest set self-reported0.093
- precision_at_3 on MTEB CQADupstackMathematicaRetrievaltest set self-reported4.022
- precision_at_5 on MTEB CQADupstackMathematicaRetrievaltest set self-reported3.060
- recall_at_1 on MTEB CQADupstackMathematicaRetrievaltest set self-reported4.121
- recall_at_10 on MTEB CQADupstackMathematicaRetrievaltest set self-reported15.201
- recall_at_100 on MTEB CQADupstackMathematicaRetrievaltest set self-reported33.923
- recall_at_1000 on MTEB CQADupstackMathematicaRetrievaltest set self-reported61.530
- recall_at_3 on MTEB CQADupstackMathematicaRetrievaltest set self-reported8.869
- recall_at_5 on MTEB CQADupstackMathematicaRetrievaltest set self-reported11.257
- map_at_1 on MTEB CQADupstackPhysicsRetrievaltest set self-reported14.090
- map_at_10 on MTEB CQADupstackPhysicsRetrievaltest set self-reported19.574
- map_at_100 on MTEB CQADupstackPhysicsRetrievaltest set self-reported20.580
- map_at_1000 on MTEB CQADupstackPhysicsRetrievaltest set self-reported20.704
- map_at_3 on MTEB CQADupstackPhysicsRetrievaltest set self-reported17.680
- map_at_5 on MTEB CQADupstackPhysicsRetrievaltest set self-reported18.640
- mrr_at_1 on MTEB CQADupstackPhysicsRetrievaltest set self-reported17.228
- mrr_at_10 on MTEB CQADupstackPhysicsRetrievaltest set self-reported23.152
- mrr_at_100 on MTEB CQADupstackPhysicsRetrievaltest set self-reported24.056
- mrr_at_1000 on MTEB CQADupstackPhysicsRetrievaltest set self-reported24.141
- mrr_at_3 on MTEB CQADupstackPhysicsRetrievaltest set self-reported21.142
- mrr_at_5 on MTEB CQADupstackPhysicsRetrievaltest set self-reported22.201
- ndcg_at_1 on MTEB CQADupstackPhysicsRetrievaltest set self-reported17.228
- ndcg_at_10 on MTEB CQADupstackPhysicsRetrievaltest set self-reported23.390
- ndcg_at_100 on MTEB CQADupstackPhysicsRetrievaltest set self-reported28.484
- ndcg_at_1000 on MTEB CQADupstackPhysicsRetrievaltest set self-reported31.709
- ndcg_at_3 on MTEB CQADupstackPhysicsRetrievaltest set self-reported19.883
- ndcg_at_5 on MTEB CQADupstackPhysicsRetrievaltest set self-reported21.340
- precision_at_1 on MTEB CQADupstackPhysicsRetrievaltest set self-reported17.228
- precision_at_10 on MTEB CQADupstackPhysicsRetrievaltest set self-reported4.379
- precision_at_100 on MTEB CQADupstackPhysicsRetrievaltest set self-reported0.826
- precision_at_1000 on MTEB CQADupstackPhysicsRetrievaltest set self-reported0.128
- precision_at_3 on MTEB CQADupstackPhysicsRetrievaltest set self-reported9.496
- precision_at_5 on MTEB CQADupstackPhysicsRetrievaltest set self-reported6.872
- recall_at_1 on MTEB CQADupstackPhysicsRetrievaltest set self-reported14.090
- recall_at_10 on MTEB CQADupstackPhysicsRetrievaltest set self-reported31.580
- recall_at_100 on MTEB CQADupstackPhysicsRetrievaltest set self-reported54.074
- recall_at_1000 on MTEB CQADupstackPhysicsRetrievaltest set self-reported77.092
- recall_at_3 on MTEB CQADupstackPhysicsRetrievaltest set self-reported21.601
- recall_at_5 on MTEB CQADupstackPhysicsRetrievaltest set self-reported25.333
- map_at_1 on MTEB CQADupstackProgrammersRetrievaltest set self-reported10.538
- map_at_10 on MTEB CQADupstackProgrammersRetrievaltest set self-reported15.750
- map_at_100 on MTEB CQADupstackProgrammersRetrievaltest set self-reported16.710
- map_at_1000 on MTEB CQADupstackProgrammersRetrievaltest set self-reported16.838
- map_at_3 on MTEB CQADupstackProgrammersRetrievaltest set self-reported13.488
- map_at_5 on MTEB CQADupstackProgrammersRetrievaltest set self-reported14.712
- mrr_at_1 on MTEB CQADupstackProgrammersRetrievaltest set self-reported13.813
- mrr_at_10 on MTEB CQADupstackProgrammersRetrievaltest set self-reported19.080
- mrr_at_100 on MTEB CQADupstackProgrammersRetrievaltest set self-reported19.946
- mrr_at_1000 on MTEB CQADupstackProgrammersRetrievaltest set self-reported20.044
- mrr_at_3 on MTEB CQADupstackProgrammersRetrievaltest set self-reported16.838
- mrr_at_5 on MTEB CQADupstackProgrammersRetrievaltest set self-reported17.951
- ndcg_at_1 on MTEB CQADupstackProgrammersRetrievaltest set self-reported13.813
- ndcg_at_10 on MTEB CQADupstackProgrammersRetrievaltest set self-reported19.669
- ndcg_at_100 on MTEB CQADupstackProgrammersRetrievaltest set self-reported24.488
- ndcg_at_1000 on MTEB CQADupstackProgrammersRetrievaltest set self-reported27.870
- ndcg_at_3 on MTEB CQADupstackProgrammersRetrievaltest set self-reported15.479
- ndcg_at_5 on MTEB CQADupstackProgrammersRetrievaltest set self-reported17.229
- precision_at_1 on MTEB CQADupstackProgrammersRetrievaltest set self-reported13.813
- precision_at_10 on MTEB CQADupstackProgrammersRetrievaltest set self-reported3.916
- precision_at_100 on MTEB CQADupstackProgrammersRetrievaltest set self-reported0.743
- precision_at_1000 on MTEB CQADupstackProgrammersRetrievaltest set self-reported0.122
- precision_at_3 on MTEB CQADupstackProgrammersRetrievaltest set self-reported7.534
- precision_at_5 on MTEB CQADupstackProgrammersRetrievaltest set self-reported5.822
- recall_at_1 on MTEB CQADupstackProgrammersRetrievaltest set self-reported10.538
- recall_at_10 on MTEB CQADupstackProgrammersRetrievaltest set self-reported28.693
- recall_at_100 on MTEB CQADupstackProgrammersRetrievaltest set self-reported50.308
- recall_at_1000 on MTEB CQADupstackProgrammersRetrievaltest set self-reported74.440
- recall_at_3 on MTEB CQADupstackProgrammersRetrievaltest set self-reported16.867
- recall_at_5 on MTEB CQADupstackProgrammersRetrievaltest set self-reported21.405