Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
8x7B-MoE-test-NOT-MIXTRAL-GGUF
like
6
Transformers
GGUF
English
Chinese
mixtral
qwen
text-generation-inference
License:
gpl-3.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
8x7B-MoE-test-NOT-MIXTRAL-GGUF
1 contributor
History:
15 commits
TheBloke
Upload README.md
5b9b03e
5 months ago
.gitattributes
2.1 kB
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q2_K.gguf
13.6 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q3_K_M.gguf
17.3 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q4_0.gguf
22.1 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q4_K_M.gguf
22.1 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q5_0.gguf
26.6 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q5_K_M.gguf
26.6 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q6_K.gguf
31.5 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
8x7b-moe-test-not-mixtral.Q8_0.gguf
40.4 GB
LFS
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago
README.md
17.6 kB
Upload README.md
5 months ago
config.json
31 Bytes
GGUF model commit (made with llama.cpp commit c6c4fc0)
5 months ago