anthracite-org
/

magnum-v3-9b-chatml-gguf

Inference Endpoints

Model card Files Files and versions Community

magnum-v3-9b-chatml-gguf

2 contributors

History: 3 commits

lucyknada's picture

Create README.md

e759ae1 verified 4 months ago

.gitattributes

2.04 kB

Upload folder using huggingface_hub 4 months ago
README.md

6.02 kB

Create README.md 4 months ago
imatrix_data.dat

6.12 MB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-IQ3_M.gguf

4.49 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-IQ3_S.gguf

4.34 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-IQ4_XS.gguf

5.18 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-Q4_K_M.gguf

5.76 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-Q5_K_M.gguf

6.65 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-Q6_K.gguf

7.59 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-v3-9b-chatml-Q8_0.gguf

9.83 GB
LFS

Upload folder using huggingface_hub 4 months ago