The official AutoGPTQ library now supports Mixtral.
#2
by
inkor
- opened
The official AutoGPTQ library now supports Mixtral. It would be desirable to update this model.
https://github.com/PanQiWei/AutoGPTQ/commit/1ce453f859d0d361c009ab4194ffe3aaf6955c4e