Hosting Mistral 7B API
#69
by
wahab12
- opened
Hello everyone,
I want to host a flask API which has an endpoint that uses the Mistral 7B model. I want to host this app somewhere. Please tell me the best hosting provider for this app? I would like to have some gpu power as well for better response
Thank you
Hello everyone,
I want to host a flask API which has an endpoint that uses the Mistral 7B model. I want to host this app somewhere. Please tell me the best hosting provider for this app? I would like to have some gpu power as well for better response
Thank you
Did you find any?
You can use runpod.io, or other similarly service. If you dont use model 24/7 use serverless part of runpod.