XelotX
/

Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants

1 contributor

History: 10 commits

XelotX's picture

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_1.gguf with huggingface_hub

b62b0fd verified 3 months ago

.gitattributes

2.23 kB

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_1.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q2_K.gguf

2.72 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q2_K.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_0.gguf

4.11 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_0.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf
4.56 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_K_M.gguf
4.37 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_K_M.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q5_0.gguf
5 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_0.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q5_1.gguf
5.45 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_1.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q5_K_M.gguf
5.14 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_K_M.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q6_K.gguf
5.95 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q6_K.gguf with huggingface_hub 3 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q8_0.gguf
7.7 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q8_0.gguf with huggingface_hub 3 months ago