EXL2 quants of Qwen1.5 110B Chat
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
(More sizes coming.)
EXL2 quants of Qwen1.5 110B Chat
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
(More sizes coming.)