File size: 284 Bytes
b21d4a3 dc66292 d466d57 |
1 2 3 4 5 6 7 8 9 |
---
license: apache-2.0
---
Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
Note, autogptq does not generate 128 group size successfully when evaluating, at this moment. So the group size is 64 |