Kooten
/

MiquMaid-v1-70B-IQ2-GGUF

Inference Endpoints

Model card Files Files and versions Community

Kooten commited on Feb 2

Commit

22463d9

•

1 Parent(s): 51bdce6

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ These quants take a while to do so please leave a like or a comment on the repo
 EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
-[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF): [IQ2-XS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-IQ2_XS.gguf), [IQ2-XXS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-IQ2_XXS.gguf), [IQ3-XXS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-IQ3_XXS.gguf)
 ### Custom format:
 ```

 EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
+[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF): [IQ2-XS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-v1-70B-IQ2_XS.gguf), [IQ2-XXS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-v1-70B-IQ2_XXS.gguf), [IQ3-XXS](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/MiquMaid-v1-70B-IQ3_XXS.gguf)
 ### Custom format:
 ```