| Quantization made by Richard Erkhov. | |
| [Github](https://github.com/RichardErkhov) | |
| [Discord](https://discord.gg/pvy7H8DZMG) | |
| [Request more models](https://github.com/RichardErkhov/quant_request) | |
| falcon-7b-sharded-bf16 - bnb 4bits | |
| - Model creator: https://huggingface.co/ybelkada/ | |
| - Original model: https://huggingface.co/ybelkada/falcon-7b-sharded-bf16/ | |
| Original model description: | |
| Entry not found | |