Hugging Face's logo

ISTA-DASLab
/
switch-large-128_qmoe

Text2Text Generation
Transformers
switch_transformers
Inference Endpoints
Model card Files Community
Edit model card

switch-large-128_qmoe

This is the google/switch-large-128 model quantized with the QMoE framework to ternary precision and stored in the custom further compressed QMoE format.

Please see the QMoE repository for how to use this model.

Downloads last month
2
Inference Examples
Text2Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.