ikawrakow
/

mistral-instruct-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mistral-instruct-7b-quantized-gguf

1 contributor

History: 3 commits

ikawrakow's picture

Update README.md

b608e0f 10 months ago

.gitattributes

1.56 kB

First shot at Mixtral-instruct-7b 10 months ago
README.md

1.48 kB

Update README.md 10 months ago
mistral-instruct-7b-q3k-medium.gguf

3.52 GB
LFS

First shot at Mixtral-instruct-7b 10 months ago
mistral-instruct-7b-q3k-small.gguf

3.17 GB
LFS

First shot at Mixtral-instruct-7b 10 months ago
mistral-instruct-7b-q40.gguf

4.11 GB
LFS

First shot at Mixtral-instruct-7b 10 months ago
mistral-instruct-7b-q4k-small.gguf

4.16 GB
LFS

First shot at Mixtral-instruct-7b 10 months ago
mistral-instruct-7b-q5k-small.gguf

5 GB
LFS

First shot at Mixtral-instruct-7b 10 months ago