yhyu13 commited on
Commit
d466d57
1 Parent(s): 6d7284d

Update readme

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -4,4 +4,6 @@ license: apache-2.0
4
 
5
  Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
6
 
7
- Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
 
 
 
4
 
5
  Genearted from https://github.com/yhyu13/AutoGPTQ.git branch cuda_dev
6
 
7
+ Original weight: https://huggingface.co/tiiuae/falcon-7b-instruct
8
+
9
+ Note, autogptq does not generate 128 group size successfully when evaluating, at this moment. So the group size is 64