jinaai

/

jina-embeddings-v2-base-en

like 627

Hello,
I want first to thank you for the amazing project and for releasing the weights of the model.
I have a doubt

If I try to run the example code

from transformers import AutoModel

model = AutoModel.from_pretrained(
    "jinaai/jina-embeddings-v2-base-en", trust_remote_code=True
)  # trust_remote_code is needed to use the encode method
embeddings = model.encode(
    ["How is the weather today?", "What is the current weather like today?"]
)

print(embeddings.shape)

I get an output with shape (2, 768), while on the MTEB leaderboard the embeddings dimension is 512.
Connected with this, is there a reason why the pooling layer size is different from the hidden size of the model?

Thanks in advance for the help