switch-base-128_qmoe

This is the google/switch-base-128 model quantized with the QMoE framework to ternary precision and stored in the custom further compressed QMoE format.

Please see the QMoE repository for how to use this model.

Downloads last month
8
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Space using ISTA-DASLab/switch-base-128_qmoe 1