ahmet1338

/

finetuned_embedder

like 0

Evaluation results

• accuracy on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  88.134
• ap on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  59.298
• f1 on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  83.318
• accuracy on MTEB AmazonPolarityClassification
  test set self-reported
  91.526
• ap on MTEB AmazonPolarityClassification
  test set self-reported
  88.163
• f1 on MTEB AmazonPolarityClassification
  test set self-reported
  91.511
• accuracy on MTEB AmazonReviewsClassification (en)
  test set self-reported
  47.856
• f1 on MTEB AmazonReviewsClassification (en)
  test set self-reported
  45.415
• map_at_1 on MTEB ArguAna
  test set self-reported
  31.223
• map_at_10 on MTEB ArguAna
  test set self-reported
  47.947
• map_at_100 on MTEB ArguAna
  test set self-reported
  48.742
• map_at_1000 on MTEB ArguAna
  test set self-reported
  48.745
• map_at_3 on MTEB ArguAna
  test set self-reported
  43.137
• map_at_5 on MTEB ArguAna
  test set self-reported
  45.992
• mrr_at_1 on MTEB ArguAna
  test set self-reported
  32.432
• mrr_at_10 on MTEB ArguAna
  test set self-reported
  48.400
• mrr_at_100 on MTEB ArguAna
  test set self-reported
  49.202
• mrr_at_1000 on MTEB ArguAna
  test set self-reported
  49.205
• mrr_at_3 on MTEB ArguAna
  test set self-reported
  43.551
• mrr_at_5 on MTEB ArguAna
  test set self-reported
  46.468
• ndcg_at_1 on MTEB ArguAna
  test set self-reported
  31.223
• ndcg_at_10 on MTEB ArguAna
  test set self-reported
  57.045
• ndcg_at_100 on MTEB ArguAna
  test set self-reported
  60.175
• ndcg_at_1000 on MTEB ArguAna
  test set self-reported
  60.233
• ndcg_at_3 on MTEB ArguAna
  test set self-reported
  47.171
• ndcg_at_5 on MTEB ArguAna
  test set self-reported
  52.322
• precision_at_1 on MTEB ArguAna
  test set self-reported
  31.223
• precision_at_10 on MTEB ArguAna
  test set self-reported
  8.599
• precision_at_100 on MTEB ArguAna
  test set self-reported
  0.991
• precision_at_1000 on MTEB ArguAna
  test set self-reported
  0.100
• precision_at_3 on MTEB ArguAna
  test set self-reported
  19.630
• precision_at_5 on MTEB ArguAna
  test set self-reported
  14.282
• recall_at_1 on MTEB ArguAna
  test set self-reported
  31.223
• recall_at_10 on MTEB ArguAna
  test set self-reported
  85.989
• recall_at_100 on MTEB ArguAna
  test set self-reported
  99.075
• recall_at_1000 on MTEB ArguAna
  test set self-reported
  99.502
• recall_at_3 on MTEB ArguAna
  test set self-reported
  58.890
• recall_at_5 on MTEB ArguAna
  test set self-reported
  71.408
• v_measure on MTEB ArxivClusteringP2P
  test set self-reported
  43.162
• v_measure on MTEB ArxivClusteringS2S
  test set self-reported
  32.564
• map on MTEB AskUbuntuDupQuestions
  test set self-reported
  64.295
• mrr on MTEB AskUbuntuDupQuestions
  test set self-reported
  76.445
• cos_sim_spearman on MTEB BIOSSES
  test set self-reported
  84.387
• accuracy on MTEB Banking77Classification
  test set self-reported
  78.513
• f1 on MTEB Banking77Classification
  test set self-reported
  77.490
• v_measure on MTEB BiorxivClusteringP2P
  test set self-reported
  37.618