mistral-community
/

Mixtral-8x22B-v0.1-4bit

Text Generation

Mixture of Experts

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

prince-canuma commited on Apr 10

Commit

ef12e5b

•

1 Parent(s): b52259f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -26,7 +26,7 @@ Model quantized and added by [Prince Canuma](https://twitter.com/Prince_Canuma)
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
-model_id = "prince-canuma/Mixtral-8x22B-v0.1-4bit"
 tokenizer = AutoTokenizer.from_pretrained(model_id)
 model = AutoModelForCausalLM.from_pretrained(model_id)

 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
+model_id = "mistral-community/Mixtral-8x22B-v0.1-4bit"
 tokenizer = AutoTokenizer.from_pretrained(model_id)
 model = AutoModelForCausalLM.from_pretrained(model_id)