Hardware requirements
#125
by
AnikaTaggd
- opened
What are the minimum hardware requirements to run this model?
Hi there !! Check here: https://docs.mistral.ai/getting-started/open_weight_models/
As it is now, 16gb of VRAM minimum for full precision- However !! This does not take into account quantization, you can run quants with less hardware requirements, you might want to check it out since most people do not run the full precision model, will depend on ur use case too !