mradermacher
/

llama-3.2-Korean-Bllossom-3B-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama-3.2-Korean-Bllossom-3B-i1-GGUF

1 contributor

History: 19 commits

mradermacher's picture

uploaded from leia

1a80660 verified 14 days ago

.gitattributes

2.76 kB

uploaded from leia 14 days ago
README.md

245 Bytes

uploaded from leia 14 days ago
imatrix.dat

2.99 MB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ1_M.gguf

924 MB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ2_M.gguf

1.23 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ2_XS.gguf

1.1 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ2_XXS.gguf

1.02 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ3_M.gguf

1.6 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ3_XXS.gguf

1.35 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-IQ4_XS.gguf

1.83 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q2_K.gguf

1.36 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q3_K_L.gguf

1.82 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q3_K_M.gguf

1.69 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q3_K_S.gguf

1.54 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q4_K_M.gguf

2.02 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q4_K_S.gguf

1.93 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q5_K_S.gguf

2.27 GB
LFS

uploaded from leia 14 days ago
llama-3.2-Korean-Bllossom-3B.i1-Q6_K.gguf

2.64 GB
LFS

uploaded from leia 14 days ago