LoneStriker
/

wolfram_miqu-1-120b-5.0bpw-h6-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Update README.md

#1

by wolfram - opened Feb 6

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

Files changed (1) hide show

README.md +6 -0

README.md CHANGED Viewed

@@ -17,6 +17,12 @@ tags:
 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/LxO9j7OykuabKLYQHIodG.jpeg)
 * GGUF: [wolfram/miqu-1-120b-GGUF](https://huggingface.co/wolfram/miqu-1-120b-GGUF)
 This is a 120b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).

 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/LxO9j7OykuabKLYQHIodG.jpeg)
 * GGUF: [wolfram/miqu-1-120b-GGUF](https://huggingface.co/wolfram/miqu-1-120b-GGUF)
+* EXL2:
+  * [LoneStriker/wolfram_miqu-1-120b-2.4bpw-h6-exl2](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-2.4bpw-h6-exl2)
+  * [LoneStriker/wolfram_miqu-1-120b-2.65bpw-h6-exl2](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-2.65bpw-h6-exl2)
+  * [LoneStriker/wolfram_miqu-1-120b-3.0bpw-h6-exl2](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-3.0bpw-h6-exl2)
+  * [LoneStriker/wolfram_miqu-1-120b-4.0bpw-h6-exl2](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-4.0bpw-h6-exl2)
+  * [LoneStriker/wolfram_miqu-1-120b-5.0bpw-h6-exl2](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-5.0bpw-h6-exl2)
 This is a 120b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).