tiiuae
/

falcon-mamba-7b-instruct-4bit

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

it run

#4 opened 25 days ago by

Cannot load quantized version of the model into a 15 GB VRAM gpu?

#3 opened 4 months ago by

PackageNotFoundError: No package metadata was found for bitsandbytes

#2 opened 4 months ago by

The checkpoint you are trying to load has model type `falcon_mamba`

#1 opened 4 months ago by