exl2 quants
#1
by
Wsdfsdf
- opened
I got access from Meta and am downloading already. It'll be at least a few hours though, 70B quants take a while.
@LoneStriker I'd appreciate you also posting the measurements file if possible. Thanks for your contributions!
Wsdfsdf
changed discussion status to
closed
@LoneStriker I'd appreciate you also posting the measurements file if possible. Thanks for your contributions!
Added to the exl2 model files, so you can download from any of the models.