multilingual-e5-small-mlx
This model was converted to MLX format from intfloat/multilingual-e5-small
.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/multilingual-e5-small-mlx --prompt "My name is"
- Downloads last month
- 8
Space using mlx-community/multilingual-e5-small-mlx 1
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported73.791
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported37.000
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported67.955
- accuracy on MTEB AmazonCounterfactualClassification (de)test set self-reported71.649
- ap on MTEB AmazonCounterfactualClassification (de)test set self-reported82.119
- f1 on MTEB AmazonCounterfactualClassification (de)test set self-reported69.880
- accuracy on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported75.810
- ap on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported24.469
- f1 on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported63.001
- accuracy on MTEB AmazonCounterfactualClassification (ja)test set self-reported64.186
- ap on MTEB AmazonCounterfactualClassification (ja)test set self-reported15.497
- f1 on MTEB AmazonCounterfactualClassification (ja)test set self-reported52.072
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported88.699
- ap on MTEB AmazonPolarityClassificationtest set self-reported85.270
- f1 on MTEB AmazonPolarityClassificationtest set self-reported88.656
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported44.698
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported43.732
- accuracy on MTEB AmazonReviewsClassification (de)test set self-reported40.246
- f1 on MTEB AmazonReviewsClassification (de)test set self-reported39.386
- accuracy on MTEB AmazonReviewsClassification (es)test set self-reported40.394
- f1 on MTEB AmazonReviewsClassification (es)test set self-reported39.301
- accuracy on MTEB AmazonReviewsClassification (fr)test set self-reported38.864
- f1 on MTEB AmazonReviewsClassification (fr)test set self-reported37.980
- accuracy on MTEB AmazonReviewsClassification (ja)test set self-reported37.682
- f1 on MTEB AmazonReviewsClassification (ja)test set self-reported37.074