Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
Falcon3-Mamba-7B-Instruct-i1-GGUF
like
0
Transformers
GGUF
English
falcon3
falcon3_mamba
falcon_mamba
Inference Endpoints
imatrix
conversational
License:
falcon-llm-license
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
01c8568
Falcon3-Mamba-7B-Instruct-i1-GGUF
1 contributor
History:
24 commits
mradermacher
uploaded from nico1
01c8568
verified
10 days ago
.gitattributes
Safe
3.18 kB
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ1_M.gguf
Safe
1.79 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ2_M.gguf
Safe
2.5 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ2_S.gguf
Safe
2.29 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ2_XS.gguf
Safe
2.27 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ2_XXS.gguf
Safe
2.06 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ3_M.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ3_S.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ3_XS.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ3_XXS.gguf
Safe
2.92 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-IQ4_XS.gguf
Safe
3.99 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q2_K.gguf
Safe
2.57 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q2_K_S.gguf
Safe
2.57 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q3_K_L.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q3_K_M.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q3_K_S.gguf
Safe
3.28 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q4_0.gguf
Safe
4.2 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q4_K_M.gguf
Safe
4.2 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q4_K_S.gguf
Safe
4.2 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q5_K_M.gguf
Safe
5.08 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q5_K_S.gguf
Safe
5.08 GB
LFS
uploaded from nico1
10 days ago
Falcon3-Mamba-7B-Instruct.i1-Q6_K.gguf
Safe
6.01 GB
LFS
uploaded from nico1
10 days ago
README.md
Safe
240 Bytes
uploaded from nico1
10 days ago
imatrix.dat
5.32 MB
LFS
uploaded from nico1
10 days ago