ming-3.0-tts 2-step distilled DiT
A 2-step CFG-free flow DiT distilled from
inclusionAI/Ming-3.0-tts-0.5B (teacher: 10-step, CFG=2).
Files
distill/dit2.onnxโ 2-step distilled DiT, fp32 ONNX.distill/dit2_int4.onnxโ MatMulNBits 4-bit quantized DiT.distill/student_2step.ptโ PyTorch student state dict.samples/teacher.wav,samples/student.wav,samples/student_int4.wav.metrics.json,diagram.png.
Metrics
| Metric | fp32 student | int4 student |
|---|---|---|
| ASR CER | 0.6296 | 0.7070 |
| Speaker cosine | 0.6480 | 0.6722 |
| Log-mel L1 | 3.9242 | 3.8014 |
| Duration ratio | 0.996 | 0.996 |
| DiT int4 probe cosine | โ | 0.995896 |
Training: 200 SFW Chinese utterances, 13,112 latent frames, 2,000 optimizer steps, batch 16, AdamW lr 1e-4, fp32.
Listening
- Teacher โ 10-step CFG=2
- Student โ 2-step CFG-free
- Student int4
Text: ้จ่ฝๅจ็ชๅฐไธ๏ผ่ฟๅค็็ฏไธ็ไธ็ไบฎ่ตทๆฅใ
Scope
This repository contains the distilled DiT and its int4 quantization. The LM, aggregator, encoder, and vocoder are not bundled here. The diagram compares 1/2/3/4-step students; this repository is the 2-step entry. SFW only. The base model is MIT licensed and its usage disclaimer applies.
Model tree for idefinity/ming-3.0-tts-2step-distill-int4
Base model
inclusionAI/Ming-3.0-tts-0.5B