1 contributor

History: 2 commits

bartowski

Llamacpp quants

c9c4f85 verified 7 months ago

.gitattributes

2.89 kB

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ2_M.gguf

4.46 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ2_S.gguf

4.27 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ2_XS.gguf

4.17 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ3_M.gguf

5.23 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ3_XS.gguf

4.96 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ3_XXS.gguf

4.79 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-IQ4_XS.gguf

5.84 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q2_K.gguf

4.68 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q3_K_L.gguf

5.77 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q3_K_M.gguf

5.46 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q3_K_S.gguf

5.11 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q4_K_M.gguf

6.3 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q4_K_S.gguf

6.07 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q5_K_M.gguf

7.04 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q5_K_S.gguf

6.91 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q6_K.gguf

7.84 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-Q8_0.gguf

9.53 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B-f32.gguf

32.1 GB
LFS

Llamacpp quants 7 months ago
Hathor_Stable-v0.2-L3-8B.imatrix

4.99 MB
LFS

Llamacpp quants 7 months ago
README.md

7.35 kB

Llamacpp quants 7 months ago