tiiuae/falcon-mamba-7b

Text Generation • Updated 4 days ago • 5.05k • 157

Note First strong attention free model for general purpose usage, based on Mamba1 architecture

tiiuae/falcon-mamba-7b-instruct

Text Generation • Updated 1 day ago • 7.56k • 42

Note FalconMamba-7B fine-tuned on instruction data, for chat-like interaction with the model

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated 7 days ago • 184 • 10

Note FalconMamba-7B quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares

tiiuae/falcon-mamba-7b-instruct-4bit

Updated 7 days ago • 273 • 12

Note FalconMamba-7B-instruct quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares

tiiuae/falcon-mamba-7b-instruct-BF16-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in BF16 format

tiiuae/falcon-mamba-7b-instruct-F16-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in F16 format

tiiuae/falcon-mamba-7b-instruct-Q8_0-GGUF

Updated 3 days ago • 6 • 2

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q8_0 format

tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format

tiiuae/falcon-mamba-7b-BF16-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in BF16 format

tiiuae/falcon-mamba-7b-F16-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in F16 format

tiiuae/falcon-mamba-7b-Q8_0-GGUF

Updated 3 days ago • 6 • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q8_0 format

tiiuae/falcon-mamba-7b-Q4_K_M-GGUF

Updated 3 days ago • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format