Estimating Resource Requirements for the Mistral Model Deployment

#69
by Jahanzaib006201 - opened

I'm planning to deploy the Mistral 7b model for production use, and I'm looking for guidance on estimating the resource requirements. What are the key factors I should consider when determining the resources needed for deploying this model in a production environment? Specifically, I'm interested in understanding the computational power (GPU), memory, storage, and any other resources that would be essential for ensuring optimal performance and scalability. Any insights or best practices on estimating these resource requirements would be greatly appreciated. Thank you!

This comment has been hidden
osanseviero changed discussion status to closed

Sign up or log in to comment