File size: 265 Bytes
406505c 4f821f3 c4047a7 |
1 2 3 4 5 6 7 8 9 10 11 |
---
library_name: transformers
pipeline_tag: text-generation
---
falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438
- group size: 128
- act order: true
- nsamples: 128
- dataset: wikitext2 |