multilingual-e5-base-mlx
This model was converted to MLX format from intfloat/multilingual-e5-base.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/multilingual-e5-base-mlx --prompt "My name is"
- Downloads last month
- 14
Space using mlx-community/multilingual-e5-base-mlx 1
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported78.970
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported43.694
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported73.381
- accuracy on MTEB AmazonCounterfactualClassification (de)test set self-reported71.724
- ap on MTEB AmazonCounterfactualClassification (de)test set self-reported82.221
- f1 on MTEB AmazonCounterfactualClassification (de)test set self-reported69.955
- accuracy on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported79.655
- ap on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported28.508
- f1 on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported66.845
- accuracy on MTEB AmazonCounterfactualClassification (ja)test set self-reported73.330
- ap on MTEB AmazonCounterfactualClassification (ja)test set self-reported20.720
- f1 on MTEB AmazonCounterfactualClassification (ja)test set self-reported59.780
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported90.638
- ap on MTEB AmazonPolarityClassificationtest set self-reported87.223
- f1 on MTEB AmazonPolarityClassificationtest set self-reported90.604
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported44.546
- f1 on MTEB AmazonReviewsClassification (en)test set self-reported44.057
- accuracy on MTEB AmazonReviewsClassification (de)test set self-reported41.828
- f1 on MTEB AmazonReviewsClassification (de)test set self-reported41.271
- accuracy on MTEB AmazonReviewsClassification (es)test set self-reported40.534
- f1 on MTEB AmazonReviewsClassification (es)test set self-reported39.821
- accuracy on MTEB AmazonReviewsClassification (fr)test set self-reported39.684
- f1 on MTEB AmazonReviewsClassification (fr)test set self-reported39.111
- accuracy on MTEB AmazonReviewsClassification (ja)test set self-reported37.436
- f1 on MTEB AmazonReviewsClassification (ja)test set self-reported37.071