Reiterate3680
/

MN-12B-Lyra-v1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

MN-12B-Lyra-v1-GGUF

1 contributor

History: 14 commits

Reiterate3680's picture

Upload imatrix.dat

cb58fca verified 4 months ago

.gitattributes

2.51 kB

Upload imatrix.dat 4 months ago
MN-12B-Lyra-v1-IQ2_M-imat.gguf

4.44 GB
LFS

Upload 3 files 4 months ago
MN-12B-Lyra-v1-IQ3_M-imat.gguf

5.72 GB
LFS

Upload 3 files 4 months ago
MN-12B-Lyra-v1-IQ4_XS-imat.gguf

6.74 GB
LFS

Upload 3 files 4 months ago
MN-12B-Lyra-v1-Q2_K_S-imat.gguf

4.49 GB
LFS

Rename MN-12B-Lyra-v1-Q2_K_M-imat.gguf to MN-12B-Lyra-v1-Q2_K_S-imat.gguf 4 months ago
MN-12B-Lyra-v1-Q3_K_L-imat.gguf

6.56 GB
LFS

Upload 2 files 4 months ago
MN-12B-Lyra-v1-Q4_K_L-imat.gguf

7.98 GB
LFS

Upload 2 files 4 months ago
MN-12B-Lyra-v1-Q4_K_M-imat.gguf

7.48 GB
LFS

Rename MN-12B-Lyra-v1-Q4_K_L-imat.gguf to MN-12B-Lyra-v1-Q4_K_M-imat.gguf 4 months ago
MN-12B-Lyra-v1-Q5_K_M-imat.gguf

8.73 GB
LFS

Rename MN-12B-Lyra-v1-Q5_K_L-imat.gguf to MN-12B-Lyra-v1-Q5_K_M-imat.gguf 4 months ago
MN-12B-Lyra-v1-Q6_K-imat.gguf

10.1 GB
LFS

Rename MN-12B-Lyra-v1-Q6_K_L-imat.gguf to MN-12B-Lyra-v1-Q6_K-imat.gguf 4 months ago
MN-12B-Lyra-v1-Q6_K_L-imat.gguf

10.4 GB
LFS

Upload 2 files 4 months ago
MN-12B-Lyra-v1-Q8_0-imat.gguf

13 GB
LFS

Upload 2 files 4 months ago
README.md

391 Bytes

Create README.md 4 months ago
imatrix.dat

7.05 MB
LFS

Upload imatrix.dat 4 months ago