tensorblock
/

Mixtral-tiny-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mixtral-tiny-GGUF

1 contributor

History: 2 commits

morriszms's picture

Upload folder using huggingface_hub

99d60ea verified 4 months ago

.gitattributes

2.24 kB

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q2_K.gguf

105 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q3_K_L.gguf

136 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q3_K_M.gguf

129 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q3_K_S.gguf

121 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q4_0.gguf

149 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q4_K_M.gguf

157 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q4_K_S.gguf

149 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q5_0.gguf

175 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q5_K_M.gguf

179 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q5_K_S.gguf

175 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q6_K.gguf

204 MB
LFS

Upload folder using huggingface_hub 4 months ago
Mixtral-tiny-Q8_0.gguf

263 MB
LFS

Upload folder using huggingface_hub 4 months ago
README.md

4.43 kB

Upload folder using huggingface_hub 4 months ago