mradermacher
/

Midnight-Rose-103B-v2.0.3-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Midnight-Rose-103B-v2.0.3-i1-GGUF

1 contributor

History: 9 commits

mradermacher's picture

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3

b9a8749 verified 12 months ago

.gitattributes

2.17 kB

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ2_XS.gguf

30.7 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ2_XXS.gguf

27.6 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ3_XXS.gguf

40.5 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-Q2_K.gguf

38.2 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-Q3_K_M.gguf.split-aa

26.8 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-Q3_K_M.gguf.split-ab

23.1 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-Q4_K_M.gguf.split-aa

31.1 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
Midnight-Rose-103B-v2.0.3.i1-Q4_K_M.gguf.split-ab

31.1 GB
LFS

imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3 12 months ago
README.md

279 Bytes

Update README.md 12 months ago