SentenceTransformers compatability - missing files

#6
by michaelfeil - opened

to make it compatible with SentenceTransformers:

  • Can you add the MeanPooling etc. for SentenceTransformers
  • other sbert.config

For reference:

https://huggingface.co/intfloat/e5-large-v2/discussions/6

Jina AI org

hi @michaelfeil thanks for your suggestion, we would love to, but it's very hard. Because sbert do not allow us to use trust_remote_code option, the latest release of sbert was last year.

I wish you understand, the jina embeddings v2 is built on top of jina bert to support longer context, not any existent backbones.

Such a shame - trust_remote_code would be such a easy feature to implement if sbert were maintained.

@michaelfeil indeed, but if you look at the model readme, we offered a encode function, the signature is exactly the same as the sbert encode function :) and you only need transformers, not sbert anymore :)

My use-case is simple, I would need it with „trust_remote_code“ to deploy it here: https://github.com/michaelfeil/infinity

It actually works now if you install sentence_transformers from source. More info in this PR: https://huggingface.co/jinaai/jina-embeddings-v2-small-en/discussions/10

bwang0911 changed discussion status to closed

Sign up or log in to comment