TheBloke
/

Mixtral-8x7B-Instruct-v0.1-GGUF

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (4)

How do you estimate the number of GPUs required to run this model?

#29 opened 21 days ago by

Ollama Modelfile

#28 opened about 2 months ago by

Help: CUDA out of memory. Hardware Requirments.

#27 opened 2 months ago by

CUDA error: the provided PTX was compiled with an unsupported toolchain.

#26 opened 3 months ago by

THANK YOU!!

#25 opened 3 months ago by

No K_S models?

#24 opened 3 months ago by

Hardware Requirements for Q4_K_M

#23 opened 3 months ago by

ShivanshMathur007

Can we finetune this gguf model for our custom need

#22 opened 3 months ago by

Download Error when deploying to SageMaker

#21 opened 4 months ago by

csanchez-aureum

Getting runtime error when loading with llama-cpp in a HF space with Nvidia A10G Large

#20 opened 4 months ago by

Q6_K version is broken

#19 opened 4 months ago by

Snake.py with pygame works!!

#16 opened 5 months ago by

Works with with the current oobabooga version.

#15 opened 5 months ago by

Issue with GPU Utilization in Colab Notebook

#14 opened 5 months ago by

Update README.md

#13 opened 5 months ago by

8x7B (Q3) vs 7B

#12 opened 5 months ago by

Update README.md

#10 opened 5 months ago by

Why is the response slower than the 70B model?

#9 opened 5 months ago by

Even this excellent high-end model doesn't follow my instructions

#8 opened 5 months ago by

Behaviour with AMD GPU offload?

#7 opened 5 months ago by

chatbot giving weird responses

#6 opened 5 months ago by

KCPP frankenstein experimental release for Mixtral

#5 opened 5 months ago by

Issue with Mixtral-8x7B-Instruct-v0.1-GGUF Model: 'blk.0.ffn_gate.weight' Tensor Not Found

#4 opened 5 months ago by

error

#3 opened 5 months ago by

WOW - best opensource llm I ever seen !

#1 opened 5 months ago by