| library_name: transformers | |
| pipeline_tag: text-generation | |
| falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438 | |
| - group size: 128 | |
| - act order: true | |
| - nsamples: 128 | |
| - dataset: wikitext2 |