Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MixTAO-7Bx2-MoE-v8.1-GGUF
like
11
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
Mixture of Experts
Eval Results
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
3f36679
MixTAO-7Bx2-MoE-v8.1-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
3f36679
verified
8 months ago
.gitattributes
1.93 kB
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
8 months ago
MixTAO-7Bx2-MoE-v8.1.IQ4_XS.gguf
6.98 GB
LFS
4b28163765d2a5c315bdcaa3301cf38dfb14b26e7c5e99ecf78f794edd8dab34
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q2_K.gguf
4.76 GB
LFS
8d47b9c5385a2dc8eb2c9be88206ebfb69b1dc76bd096d796762c6bfb82a5421
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_L.gguf
6.73 GB
LFS
fbbc5d324ce0fc2bc49486dfc969642c072e64ccb8fc450d227eed2ed9448812
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_M.gguf
6.21 GB
LFS
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_S.gguf
5.59 GB
LFS
0766c80af2c1e979e3f375d47d4b610b71f3c27965eb2e35df8045b317d028d0
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_M.gguf
7.78 GB
LFS
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
8 months ago
