mradermacher
/

Falcon3-1B-Instruct-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Falcon3-1B-Instruct-i1-GGUF

1 contributor

History: 16 commits

mradermacher's picture

uploaded from rich1

26c598d verified about 2 months ago

.gitattributes

2.49 kB

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ1_M.gguf

536 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ2_M.gguf

684 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ2_XXS.gguf

575 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ3_M.gguf

847 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ3_XXS.gguf

735 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-IQ4_XS.gguf

969 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q2_K.gguf

727 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q2_K_S.gguf

693 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q3_K_M.gguf

885 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q3_K_S.gguf

827 MB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q4_K_M.gguf

1.06 GB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q4_K_S.gguf

1.02 GB
LFS

uploaded from rich1 about 2 months ago
Falcon3-1B-Instruct.i1-Q6_K.gguf

1.37 GB
LFS

uploaded from rich1 about 2 months ago
README.md

234 Bytes

uploaded from rich1 about 2 months ago
imatrix.dat

1.48 MB
LFS

uploaded from rich1 about 2 months ago