ZipEnhancer (16 kHz) — portable ONNX
Portable ONNX export of ZipEnhancer
(iic/speech_zipenhancer_ans_multiloss_16k_base
on ModelScope, revision bed374bb53e4a5ffc62093676bab408a56b0db48, file pytorch_model.bin), the noise suppressor
that VoxCPM2 uses for its denoise option.
PatiPix Studio uses it for the optional « Remove background noise » step of its voice cloning.
Why a new export: the ONNX file published with the original model was optimized by ONNX Runtime for the processor
that prepared it (com.microsoft.nchwc operators), so it is not safe on other PCs. This export only uses standard
ONNX operators.
Inputs and outputs
| Name | Shape | Meaning |
|---|---|---|
noisy_mag (input) |
[1, 201, T] | STFT magnitude, compressed (power 0.3) |
noisy_pha (input) |
[1, 201, T] | STFT phase |
amp_g, pha_g (outputs) |
[1, 201, T] | cleaned magnitude (compressed) and phase |
STFT as in ModelScope's mag_pha_stft / mag_pha_istft: 16 kHz audio normalised to unit RMS, 400 points, hop 100,
periodic Hann window, centered with reflect padding. Valid up to T = 961 frames (6 s) in one block, like the official
pipeline, which processes longer audio in 2 s chunks (0.25 s dropped on each side).
How it was made
Official ModelScope 1.40.2 code, torch 2.10.0, TorchScript export (dynamo=False), opset 17, weights unchanged.
Checked on the two official noisy examples: amplitude difference between ONNX and PyTorch below 3e-6; the full chain agrees with the official ModelScope pipeline at 58 to 61 dB (the limit of 16-bit audio).
File
| File | Size (bytes) | SHA-256 |
|---|---|---|
zipenhancer.onnx |
9,591,998 | 4ae0b92cd0d5933dc3f4896cd0ad62132e0249d4b6f4b33d95c7518a364d3c70 |
License and credits
Apache License 2.0, like the original model (see LICENSE). Original work: ZipEnhancer by the Tongyi Lab (Alibaba).