How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?

#33

by chenkun - opened Mar 14

Mar 14

Hi,

How multilingual-e5-large can be used as a standalone service to support Python like OpenAIEmbeddings?
(Like FastChat, but multilingual-e5-large is not in the list of models supported by FastChat.)

My current deployment method is HuggingFaceEmbedding, but it cannot be shared between multiple programs:

embedding = HuggingFaceEmbeddings(
    model_name='xxx'
)

TungLam

Mar 26

You can build a Flask application to serve the model as API and call API in other programs

chenkun

Apr 6

Hi @TungLam , could you give me a specific code example or tutorial link? Thank you.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment