turboderp
/

Mixtral-8x22B-Instruct-v0.1-exl2

Model card Files Files and versions Community

Mixtral-8x22B-Instruct-v0.1-exl2 / README.md

turboderp's picture

Create README.md

d058038 verified 6 months ago

|

474 Bytes

EXL2 quants of Mixtral 8x22B Instruct v0.1

More bitrates still cooking

2.30 bits per weight
4.00 bits per weight

measurement.json