Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MixTAO-7Bx2-MoE-v8.1-GGUF
like
11
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
Mixture of Experts
Eval Results
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
3f2f654
MixTAO-7Bx2-MoE-v8.1-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
618422b7621542d1f15b046ecf2fd8aee34991ac9d9cc37f88ccd29033d65979
3f2f654
verified
8 months ago
.gitattributes
2.07 kB
618422b7621542d1f15b046ecf2fd8aee34991ac9d9cc37f88ccd29033d65979
8 months ago
MixTAO-7Bx2-MoE-v8.1.IQ4_XS.gguf
6.98 GB
LFS
4b28163765d2a5c315bdcaa3301cf38dfb14b26e7c5e99ecf78f794edd8dab34
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q2_K.gguf
4.76 GB
LFS
8d47b9c5385a2dc8eb2c9be88206ebfb69b1dc76bd096d796762c6bfb82a5421
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_L.gguf
6.73 GB
LFS
fbbc5d324ce0fc2bc49486dfc969642c072e64ccb8fc450d227eed2ed9448812
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_M.gguf
6.21 GB
LFS
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_S.gguf
5.59 GB
LFS
0766c80af2c1e979e3f375d47d4b610b71f3c27965eb2e35df8045b317d028d0
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_M.gguf
7.78 GB
LFS
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_S.gguf
7.34 GB
LFS
e22ffe20f3f05897cc8e8726393131eff2c1610063097d4aa3cafdbce94cc5e3
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q5_K_M.gguf
9.13 GB
LFS
618422b7621542d1f15b046ecf2fd8aee34991ac9d9cc37f88ccd29033d65979
8 months ago
