EXL2 quants of Llama2-70B-chat
2.30 bits per weight
2.35 bits per weight
2.40 bits per weight
2.45 bits per weight
2.50 bits per weight
2.55 bits per weight
2.60 bits per weight
2.70 bits per weight
3.00 bits per weight
4.00 bits per weight
4.65 bits per weight
measurement.json