Hi, thanks for providing this quantized version of Falcon-40b-instruct.Did you evaluate it on some benchmarks? Does it perform similarly to the non-quantized model?Thanks!
· Sign up or log in to comment
