dtsj89/puki-syrinx

Puki Syrinx

Puki's voice for weak tablets: the vector estimator and vocoder of BlueTTS (by Max Melichov, MIT License) in int8, for Puki, a free Hebrew/English game for toddlers. The other files of the bundle are BlueTTS's own, unchanged, with the Noa voice.

Almost all of these two models' weights sit in 1x1 convolutions, which ONNX Runtime's int8 doesn't reach on Android (no ConvInteger). Each one was rewritten as the same sum with a MatMul (transpose, MatMul, bias, transpose back), and MatMul weights were then quantized to int8, per channel (dynamic). The rewrite alone is exact (largest sample difference 0.0003); with int8, a line differs from the original less than two renders of the original with different noise do, and no difference is heard. How: train/squawk_quant.py in Puki's repo.

	vector_estimator	vocoder
BlueTTS (float)	132 MB	101 MB
Syrinx (int8)	35 MB	36 MB

On a Samsung Galaxy Tab A7 Lite (MediaTek MT8768, 3 GB), 4 threads, 5 flow steps with the first 3 guided: a 1.7-second line in 1.2 s (the float models: 2.5 s), faster than it plays.

The syrinx is a bird's voice organ: parrots speak with it, not with a larynx.

BlueTTS's license (MIT) is in LICENSE-BlueTTS.