Added Exl2 quantized versions

michaelfeil changed pull request status to merged
Gradient AI org

Thanks!

Gradient AI org

Feel free to also add it for the 1M if you have time for it!

Sign up or log in to comment