sh0416

/

random_embedding

Copied

like 0

Evaluation results

• accuracy on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  72.761
• ap on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  35.347
• f1 on MTEB AmazonCounterfactualClassification (en)
  test set self-reported
  66.691
• accuracy on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  70.353
• ap on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  82.061
• f1 on MTEB AmazonCounterfactualClassification (de)
  test set self-reported
  68.814
• accuracy on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  73.613
• ap on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  21.002
• f1 on MTEB AmazonCounterfactualClassification (en-ext)
  test set self-reported
  60.106
• accuracy on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  65.546
• ap on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  15.077
• f1 on MTEB AmazonCounterfactualClassification (ja)
  test set self-reported
  52.498
• accuracy on MTEB AmazonPolarityClassification
  test set self-reported
  55.739
• ap on MTEB AmazonPolarityClassification
  test set self-reported
  53.341
• f1 on MTEB AmazonPolarityClassification
  test set self-reported
  54.918
• accuracy on MTEB Banking77Classification
  test set self-reported
  60.231
• f1 on MTEB Banking77Classification
  test set self-reported
  60.354
• accuracy on MTEB EmotionClassification
  test set self-reported
  20.115
• f1 on MTEB EmotionClassification
  test set self-reported
  18.226
• accuracy on MTEB ImdbClassification
  test set self-reported
  53.826
• ap on MTEB ImdbClassification
  test set self-reported
  52.107
• f1 on MTEB ImdbClassification
  test set self-reported
  52.930
• accuracy on MTEB MTOPDomainClassification (en)
  test set self-reported
  70.812
• f1 on MTEB MTOPDomainClassification (en)
  test set self-reported
  70.000
• accuracy on MTEB MTOPDomainClassification (de)
  test set self-reported
  70.473
• f1 on MTEB MTOPDomainClassification (de)
  test set self-reported
  67.557