legraphista
/

RoMistral-7b-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

Edit model card

RoMistral-7b-Instruct-GGUF

This is GGUF quantized version of OpenLLM-Ro/RoMistral-7b-Instruct created using llama.cpp

Downloads last month: 109

GGUF

Model size

7.24B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API (serverless) has been turned off for this model.

Quantized from

Collection including legraphista/RoMistral-7b-Instruct-GGUF

RoMistral GGUF

GGUF variants of https://huggingface.co/collections/OpenLLM-Ro/romistral-6647241bf2cbbe9fd8c2afa4 • 2 items • Updated 7 days ago