Intel
/

falcon-7b-int4-inc

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

falcon-7b-int4-inc / configuration_falcon.py

Commit History

replace with groupsize 64

736dd5e

wenhuach commited on May 28