- Downloads last month
- 148
Inference API (serverless) does not yet support model repos that contain custom code.
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported92.358
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported70.813
- ap_weighted on MTEB AmazonCounterfactualClassification (en)test set self-reported70.813
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported88.951
- f1_weighted on MTEB AmazonCounterfactualClassification (en)test set self-reported92.686
- main_score on MTEB AmazonCounterfactualClassification (en)test set self-reported92.358
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported97.195
- ap on MTEB AmazonPolarityClassificationtest set self-reported96.082
- ap_weighted on MTEB AmazonPolarityClassificationtest set self-reported96.082
- f1 on MTEB AmazonPolarityClassificationtest set self-reported97.194