jamesgpt1

/

zzz

like 0

Evaluation results

• accuracy on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  69.731
• ap on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  31.618
• f1 on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  63.303
• accuracy on MTEB AmazonPolarityClassification
  test set self-reported
  86.898
• ap on MTEB AmazonPolarityClassification
  test set self-reported
  82.395
• f1 on MTEB AmazonPolarityClassification
  test set self-reported
  86.873
• accuracy on MTEB AmazonReviewsClassification (en)
  test set self-reported
  44.050
• f1 on MTEB AmazonReviewsClassification (en)
  test set self-reported
  42.676
• map_at_1 on MTEB ArguAna
  test set self-reported
  26.174
• map_at_10 on MTEB ArguAna
  test set self-reported
  40.976
• map_at_100 on MTEB ArguAna
  test set self-reported
  42.067
• map_at_1000 on MTEB ArguAna
  test set self-reported
  42.075
• map_at_3 on MTEB ArguAna
  test set self-reported
  35.917
• map_at_5 on MTEB ArguAna
  test set self-reported
  38.656
• mrr_at_1 on MTEB ArguAna
  test set self-reported
  26.814
• mrr_at_10 on MTEB ArguAna
  test set self-reported
  41.252
• mrr_at_100 on MTEB ArguAna
  test set self-reported
  42.337
• mrr_at_1000 on MTEB ArguAna
  test set self-reported
  42.345
• mrr_at_3 on MTEB ArguAna
  test set self-reported
  36.226
• mrr_at_5 on MTEB ArguAna
  test set self-reported
  38.914
• ndcg_at_1 on MTEB ArguAna
  test set self-reported
  26.174
• ndcg_at_10 on MTEB ArguAna
  test set self-reported
  49.819
• ndcg_at_100 on MTEB ArguAna
  test set self-reported
  54.404
• ndcg_at_1000 on MTEB ArguAna
  test set self-reported
  54.590
• ndcg_at_3 on MTEB ArguAna
  test set self-reported
  39.231
• ndcg_at_5 on MTEB ArguAna
  test set self-reported
  44.189
• precision_at_1 on MTEB ArguAna
  test set self-reported
  26.174
• precision_at_10 on MTEB ArguAna
  test set self-reported
  7.838
• precision_at_100 on MTEB ArguAna
  test set self-reported
  0.982
• precision_at_1000 on MTEB ArguAna
  test set self-reported
  0.100
• precision_at_3 on MTEB ArguAna
  test set self-reported
  16.287
• precision_at_5 on MTEB ArguAna
  test set self-reported
  12.191
• recall_at_1 on MTEB ArguAna
  test set self-reported
  26.174
• recall_at_10 on MTEB ArguAna
  test set self-reported
  78.378
• recall_at_100 on MTEB ArguAna
  test set self-reported
  98.222
• recall_at_1000 on MTEB ArguAna
  test set self-reported
  99.644
• recall_at_3 on MTEB ArguAna
  test set self-reported
  48.862
• recall_at_5 on MTEB ArguAna
  test set self-reported
  60.953
• v_measure on MTEB ArxivClusteringP2P
  test set self-reported
  42.317
• v_measure on MTEB ArxivClusteringS2S
  test set self-reported
  31.280
• map on MTEB AskUbuntuDupQuestions
  test set self-reported
  58.791
• mrr on MTEB AskUbuntuDupQuestions
  test set self-reported
  71.796
• cos_sim_pearson on MTEB BIOSSES
  test set self-reported
  76.449
• cos_sim_spearman on MTEB BIOSSES
  test set self-reported
  70.866
• euclidean_pearson on MTEB BIOSSES
  test set self-reported
  74.122
• euclidean_spearman on MTEB BIOSSES
  test set self-reported
  70.866
• manhattan_pearson on MTEB BIOSSES
  test set self-reported
  74.008
• manhattan_spearman on MTEB BIOSSES
  test set self-reported
  70.684
• accuracy on MTEB Banking77Classification
  test set self-reported
  75.406
• f1 on MTEB Banking77Classification
  test set self-reported
  74.295
• v_measure on MTEB BiorxivClusteringP2P
  test set self-reported
  37.419