Hugging Face's logo

wolfram
/
miqu-1-103b-5.0bpw-h6-exl2

Text Generation
Transformers
Safetensors
5 languages
llama
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
wolfram commited on
Commit
05d74ef
•
1 Parent(s): 58ffed3

Update README.md

Browse files

Added wolfram/miqu-1-103b-GGUF as well

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ tags:
17
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/LxO9j7OykuabKLYQHIodG.jpeg)
18
 
19
  - HF: [wolfram/miqu-1-103b](https://huggingface.co/wolfram/miqu-1-103b)
20
- - GGUF: mradermacher's [static quants](https://huggingface.co/mradermacher/miqu-1-103b-GGUF) | [weighted/imatrix quants](https://huggingface.co/mradermacher/miqu-1-103b-i1-GGUF)
21
  - EXL2: wolfram/miqu-1-103b-5.0bpw-h6-exl2 | LoneStriker's [2.4bpw](https://huggingface.co/LoneStriker/miqu-1-103b-2.4bpw-h6-exl2) | [3.0bpw](https://huggingface.co/LoneStriker/miqu-1-103b-3.0bpw-h6-exl2) | [3.5bpw](https://huggingface.co/LoneStriker/miqu-1-103b-3.5bpw-h6-exl2)
22
 
23
  This is a 103b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).
 
17
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/LxO9j7OykuabKLYQHIodG.jpeg)
18
 
19
  - HF: [wolfram/miqu-1-103b](https://huggingface.co/wolfram/miqu-1-103b)
20
+ - GGUF: [wolfram/miqu-1-103b-GGUF](https://huggingface.co/wolfram/miqu-1-103b-GGUF) | mradermacher's [static quants](https://huggingface.co/mradermacher/miqu-1-103b-GGUF) | [weighted/imatrix quants](https://huggingface.co/mradermacher/miqu-1-103b-i1-GGUF)
21
  - EXL2: wolfram/miqu-1-103b-5.0bpw-h6-exl2 | LoneStriker's [2.4bpw](https://huggingface.co/LoneStriker/miqu-1-103b-2.4bpw-h6-exl2) | [3.0bpw](https://huggingface.co/LoneStriker/miqu-1-103b-3.0bpw-h6-exl2) | [3.5bpw](https://huggingface.co/LoneStriker/miqu-1-103b-3.5bpw-h6-exl2)
22
 
23
  This is a 103b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).