Hunyuan-MT2 1.8B — 8-bit (MLX)

An 8-bit, group-size-64 MLX quantization of Tencent's Hy-MT2-1.8B, for on-device translation on Apple Silicon. ~33 languages, particularly strong into Chinese / Japanese / Korean. The "hi-fi" tier — a 6-bit variant is also available at a smaller size.

Base model tencent/Hy-MT2-1.8B
Quantization 8-bit, group size 64, affine (≈8.5 bits/weight)
Format MLX safetensors
Size ~1.8 GB

License & attribution

Subject to the Tencent Hunyuan Community License Agreement — see the license. Use restrictions apply (including commercial-use conditions, and a prohibition on using outputs to train other models). Powered by Tencent Hunyuan. Credit: Tencent. This repository only provides an MLX-quantized copy of the released weights and is redistributed under the same license.

Downloads last month
68
Safetensors
Model size
0.5B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for translate-studio/Hunyuan-MT2-1.8B-8bit-MLX

Quantized
(31)
this model