Instructions to use OptimaMT/ja-en with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use OptimaMT/ja-en with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('translation', 'OptimaMT/ja-en');
OptimaMT ja β en (Japanese to English)
Drop-in copy of Xenova/opus-mt-ja-en at revision 1a906cfaaf7c with a lighter merged decoder: ONNX Runtime's fast mode (disable_quant_qdq = 1, 2.3β2.5Γ faster) at half the memory. Same weights, same tokens.
Part of OptimaMT: all 49 pairs, named OptimaMT/<src>-<tgt>.
Used in production:
- OpenCircle, a desktop screen translator for Windows and Linux, ships these models since v0.1.4.
| Memory after load | Linux | Windows | Identical tokens |
|---|---|---|---|
disable_quant_qdq = 1 |
513 β 276 MiB (-46 %) | 488 β 253 MiB (-48 %) | yes |
| ONNX Runtime defaults | 274 β 214 MiB (-22 %) | 194 β 164 MiB (-16 %) | yes |
FLORES-200 devtest (1,012 sentences): the same translations as the original, BLEU 17.68, chrF 47.7 (greedy).
ONNX Runtime 1.31.1, CPU, 4 threads (Linux; Windows in a VM). Interactive results: OptimaMT/results Β· method: REPORT.md.
Use
import { pipeline } from "@huggingface/transformers";
const translator = await pipeline("translation", "OptimaMT/ja-en", {
dtype: "q8",
session_options: { extra: { session: { disable_quant_qdq: "1" } } },
});
const [out] = await translator("η―ε°γ―ζ΅·ε²Έγ«η«γ£γ¦γγΎγγ");
console.log(out.translation_text);
Python (translate.py: onnxruntime, sentencepiece, numpy):
python translate.py OptimaMT/ja-en "η―ε°γ―ζ΅·ε²Έγ«η«γ£γ¦γγΎγγ"
Files
Only onnx/decoder_model_merged_quantized.onnx is rebuilt; every other file is the original, byte for byte.
Vocabulary: 60,716 tokens.
Licence and credits
- Weights: OPUS-MT by the University of Helsinki, CC BY 4.0.
- ONNX export: Xenova/opus-mt-ja-en at revision
1a906cfaaf7c. - Modified: the decoder's output projection was moved out of its two branches (graph change only). CC BY 4.0.
- Downloads last month
- 28