anthracite-org
/

magnum-v2.5-12b-kto-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

magnum-v2.5-12b-kto-gguf

2 contributors

History: 5 commits

lucyknada's picture

Update README.md

3a1aedf verified 3 months ago

.gitattributes

1.98 kB

Upload folder using huggingface_hub 3 months ago
README.md

1.95 kB

Update README.md 3 months ago
imatrix_data.dat

7.05 MB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-IQ3_M.gguf

5.72 GB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-IQ3_S.gguf

5.56 GB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-IQ4_XS.gguf

6.74 GB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-Q4_K_M.gguf

7.48 GB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-Q5_K_M.gguf

8.73 GB
LFS

Upload folder using huggingface_hub 3 months ago
magnum-12b-v2.5-kto-Q8_0.gguf

13 GB
LFS

Upload folder using huggingface_hub 3 months ago