LeroyDyer
/

Mixtral_Base

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

LeroyDyer commited on Mar 15

Commit

e044ce1

•

1 Parent(s): 6fde52b

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -47,3 +47,4 @@ merge_method: linear
 dtype: float16
 ```

 dtype: float16
 ```
+Needs quantizing to 4bit etc. the Q8_0 Works well!(Untuned!)