MTEB performance
Very impressed by the MTEB performance, nice work!
Do you plan to open-source the model / is there a way for people to use it and verify the results?
Thank you for your congrats.
We are preparing to release the API of the v1 model, which is a lighter version of the two.
When it's ready, we will give information to access and use our API.
BTW, the benchmark results of our models have not been showing on the MTEB leaderboard even after clicking a refresh button on the bottom since a few days ago.
Can you check this problem?
Cool if fine with you let's show it on the leaderboard once your API/information is released?
It's manually skipped for now cuz there is not much for people to do atm as there's no model/api.
Once it appears as No 1 on the leaderboard it will probably get quite some attention, so I think it is best for you if people can then immediately start using it 😄
We are just releasing Sionic AI's embedding v1 here : https://huggingface.co/sionic-ai/sionic-ai-v1
We've described how-to instructions and example MTEB evaluation code on the site above.
Thanks. It's now on the leaderboard, great job!