Instructions to use translate-studio/Hunyuan-MT2-1.8B-8bit-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use translate-studio/Hunyuan-MT2-1.8B-8bit-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Hunyuan-MT2-1.8B-8bit-MLX translate-studio/Hunyuan-MT2-1.8B-8bit-MLX
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Hunyuan-MT2 1.8B — 8-bit (MLX)
An 8-bit, group-size-64 MLX quantization of Tencent's
Hy-MT2-1.8B, for on-device translation on
Apple Silicon. ~33 languages, particularly strong into Chinese / Japanese / Korean. The "hi-fi"
tier — a 6-bit variant is also available at a smaller size.
| Base model | tencent/Hy-MT2-1.8B |
| Quantization | 8-bit, group size 64, affine (≈8.5 bits/weight) |
| Format | MLX safetensors |
| Size | ~1.8 GB |
License & attribution
Subject to the Tencent Hunyuan Community License Agreement — see the license. Use restrictions apply (including commercial-use conditions, and a prohibition on using outputs to train other models). Powered by Tencent Hunyuan. Credit: Tencent. This repository only provides an MLX-quantized copy of the released weights and is redistributed under the same license.
- Downloads last month
- 68
Model size
0.5B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit
Model tree for translate-studio/Hunyuan-MT2-1.8B-8bit-MLX
Base model
tencent/Hy-MT2-1.8B