mistralai

/

Mixtral-8x7B-v0.1

like 1.56k

I know that mistral has integrated with openai and can be used online by openai-python. Here is the thing, I want to host a local mixtral model and change the base_url param like :

client = OpenAI(
   base_url="http://localhost:12345"
)

Thanksss:)