GitHub repository: IST-DASLab/qmoe
Primary language: Python
Description: Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".