jsfs11
/

MixtureofMerges-MoE-2x7b-SLERPv0.9b-GGUF

zhengr/MixTAO-7Bx2-MoE-v8.1

jsfs11/MixtureofMerges-MoE-2x7b-v6

Inference Endpoints

Model card Files Files and versions Community

jsfs11 commited on Apr 8

Commit

5a387d4

•

1 Parent(s): efebb90

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -13,8 +13,10 @@ base_model:
 ---
 # jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b-GGUF
-This model was converted to GGUF format from [`jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b`](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
-Refer to the [original model card](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b) for more details on the model.
 ## Use with llama.cpp
 Install llama.cpp through brew.

 ---
 # jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b-GGUF
+* This model was converted to GGUF format from [`jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b`](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
+* Refer to the [original model card](https://huggingface.co/jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b) for more details on the model.
+* Imatrix quants done manually, imatrix.dat provided.
 ## Use with llama.cpp
 Install llama.cpp through brew.