metadata
library_name: transformers
pipeline_tag: text-generation
falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438 group size: 128 act order: true nsamples: 128 dataset: wikitext2