mradermacher
/

Falcon3-10B-Instruct-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Falcon3-10B-Instruct-i1-GGUF

1 contributor

History: 17 commits

mradermacher's picture

uploaded from leia

647bc70 verified about 21 hours ago

.gitattributes

2.57 kB

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ1_M.gguf

2.56 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ2_M.gguf

3.59 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ2_XS.gguf

3.18 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ2_XXS.gguf

2.9 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ3_M.gguf

4.7 GB
LFS

uploaded from leia about 22 hours ago
Falcon3-10B-Instruct.i1-IQ3_XXS.gguf

4.08 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-IQ4_XS.gguf

5.6 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q2_K.gguf

3.92 GB
LFS

uploaded from leia about 23 hours ago
Falcon3-10B-Instruct.i1-Q2_K_S.gguf

3.67 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q3_K_L.gguf

5.45 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q3_K_M.gguf

5.05 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q3_K_S.gguf

4.59 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q4_K_M.gguf

6.29 GB
LFS

uploaded from leia about 21 hours ago
Falcon3-10B-Instruct.i1-Q5_K_S.gguf

7.14 GB
LFS

uploaded from leia about 21 hours ago
README.md

235 Bytes

uploaded from leia about 23 hours ago
imatrix.dat

6.64 MB
LFS

uploaded from leia about 23 hours ago