Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
5 languages
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
36
New discussion

'output_norm.weight' not found

2
#36 opened about 1 month ago by harryballantyne

Mixtral 8x22B mixing up syllables

1
#35 opened about 1 month ago by Stefanvarunix

How to merge .gguf into one file?

2
#34 opened about 1 month ago by Lunitaris

MistralTokenizer

3
#33 opened about 1 month ago by Esj-DL

Llama-cpp-python meet ValueError: Failed to create llama_context
#32 opened about 1 month ago by zhouzr

Tokenizer is match？especially for function / tool call

1
#31 opened about 1 month ago by zhouzr

Less is more

5
#25 opened about 2 months ago by Henk717

llama_model_load: error loading model: vocab size mismatch

4
#8 opened about 2 months ago by luccazen

A request

4
#6 opened about 2 months ago by Hoioi