MTEB evaluation results on English language for 'multi-qa-MiniLM-L6-cos-v1' sbert model
Model and licence can be found here
- Downloads last month
- 431
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Space using djovak/multi-qa-MiniLM-L6-cos-v1 1
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported61.791
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported25.829
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported56.004
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported62.361
- ap on MTEB AmazonPolarityClassificationtest set self-reported57.689
- f1 on MTEB AmazonPolarityClassificationtest set self-reported62.248
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported29.590
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported29.242
- map_at_1 on MTEB ArguAnatest set self-reported25.249
- map_at_10 on MTEB ArguAnatest set self-reported40.196