Hello, can you quantize it in AQLM ? (https://www.marktechpost.com/2024/03/17/this-paper-introduces-aqlm-a-machine-learning-algorithm-that-helps-in-the-extreme-compression-of-large-language-models-via-additive-quantization/)
· Sign up or log in to comment
