File size: 380 Bytes
f6b4908 |
1 2 3 4 5 |
Paper: [https://arxiv.org/abs/2308.13137](https://arxiv.org/abs/2308.13137)
Code: [https://github.com/OpenGVLab/OmniQuant](https://github.com/OpenGVLab/OmniQuant)
To run this model, refer [https://github.com/OpenGVLab/OmniQuant/blob/main/runing_quantized_mixtral_7bx8.ipynb](https://github.com/OpenGVLab/OmniQuant/blob/main/runing_quantized_mixtral_7bx8.ipynb) for more details. |