Hugging Face's logo

MaziyarPanahi
/
Mistral-Large-Instruct-2407-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card Files Community
14
New discussion

How much GPU Memory is needed?

1
#14 opened about 1 month ago by rsoika

how to serve the model with parallelism
#13 opened 4 months ago by lone17

How to convert GGUF

3
#11 opened 4 months ago by Jasper17