optimum

/

all-MiniLM-L6-v2

like 11

there is model.onnx file but that can only be read with optimum I guess , and I want to read that with sentence transformer and i am not able to
did you find any solution

@amorfati Use the original (non-onnx) model?

Hey folks, yes this is an ONNX model converted from sentence-transformers/all-MiniLM-L6-v2 by optimum. You would be able to leverage it for inference with APIs in optimum, more details here.

@drmeir , I used with optimum , it is working if you want ,i can share code

@amorfati Yes, please do!

https://www.philschmid.de/optimize-sentence-transformers

This article saved my days.

I had tried that code already and it failed: https://github.com/philschmid/optimum-transformers-optimizations/issues/2

Hi everyone, here's a minimal example to use sentence-transformers with optimum:
https://colab.research.google.com/drive/1ieB91hNJPooS6_VN_dgq0y87bm0q52_k?usp=sharing
The key component is ORTModelForFeatureExtraction which is equivalent to AutoModel in the model card example