Add modules.json for sentence-transformers

#19
by mdumandag - opened

As far as I can tell from the previous discussions, it is OK to use this model with sentence-transformers.

However, since there is no modules.json here, we are faced with the log saying

 No sentence-transformers model found with name WhereIsAI/UAE-Large-V1. Creating a new one with MEAN pooling.

while initializing the model.

I think it would be good to have support for sentence-transformers out of the box. Also, as the log message says, it uses mean pooling by default, but from the paper, it seems we would be better of by using the cls pooling strategy, which is also supported by sentence-transformers.

What do you think about adding this to repo?

WhereIsAI org

Thank you @mdumandag , I think it is a good suggestion. I can support this tomorrow.

WhereIsAI org

@mdumandag hi, it supports sentence_transformers now.

from sentence_transformers import SentenceTransformer

st = SentenceTransformers('WhereIsAI/UAE-Large-V1')

st.encode('hello world')

Thank you very much for promptly resolving this. I am closing this now, as it is done

mdumandag changed discussion status to closed

Sign up or log in to comment