RichardErkhov
/

ybelkada_-_falcon-7b-sharded-bf16-4bits

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

ybelkada_-_falcon-7b-sharded-bf16-4bits / README.md

RichardErkhov's picture

uploaded readme

3dd1eec verified 5 months ago

|

No virus

404 Bytes

Quantization made by Richard Erkhov.

Request more models

falcon-7b-sharded-bf16 - bnb 4bits

Model creator: https://huggingface.co/ybelkada/
Original model: https://huggingface.co/ybelkada/falcon-7b-sharded-bf16/

Original model description: Entry not found