Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Quant-Cartel
/
magnum-72b-v1-iMat-GGUF
like
3
Follow
Quant Cartel
16
GGUF
chat
qwen
opus
Inference Endpoints
imatrix
conversational
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
Deploy
Use this model
688f25d
magnum-72b-v1-iMat-GGUF
1 contributor
History:
20 commits
InferenceIllusionist
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
688f25d
verified
5 months ago
.gitattributes
3.1 kB
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
5 months ago
LICENSE
0 Bytes
initial commit
5 months ago
README.md
1.31 kB
Update README.md
5 months ago
magnum-72b-v1-iMat-IQ1_M.gguf
23.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_M.gguf
5 months ago
magnum-72b-v1-iMat-IQ1_S.gguf
22.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_S.gguf
27.9 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XS.gguf
27.1 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XS.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XXS.gguf
25.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XXS.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_M.gguf
35.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_M.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_S.gguf
34.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_XS.gguf
32.8 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_XS.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_XXS.gguf
31.8 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_XXS.gguf
5 months ago
magnum-72b-v1-iMat-IQ4_XS.gguf
39.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
5 months ago
magnum-72b-v1-iMat-Q2_K.gguf
29.8 GB
LFS
Upload magnum-72b-v1-iMat-Q2_K.gguf
5 months ago
magnum-72b-v1-iMat-Q3_K_M.gguf
37.7 GB
LFS
Upload magnum-72b-v1-iMat-Q3_K_M.gguf
5 months ago
magnum-72b-v1-iMat-Q4_K_M.gguf
47.4 GB
LFS
Upload magnum-72b-v1-iMat-Q4_K_M.gguf
5 months ago
magnum-72b-v1-iMat-Q4_K_S.gguf
43.9 GB
LFS
Upload magnum-72b-v1-iMat-Q4_K_S.gguf
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00002-of-00002.gguf
9.46 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00002-of-00002.gguf
6.41 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00001-of-00002.gguf
44.8 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00002-of-00002.gguf
19.6 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00001-of-00002.gguf
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00002-of-00002.gguf
32.3 GB
LFS
Upload 2 files
5 months ago
