ONNX

PR: Update it_IT-serena-medium and it_IT-serena-high (fixed: sentence-initial word collapse)

#96
by bacca87 - opened

What this PR changes

Updates it/it_IT/serena/{medium,high}/ in the voice catalog with the fixed version
of both it_IT-serena-medium and it_IT-serena-high voices:

  • it_IT-serena-{medium,high}.onnx β€” re-exported from the fine-tuned checkpoints (v2)
  • it_IT-serena-{medium,high}.onnx.json β€” updated to match the new models (phoneme_id_map,
    piper_version 1.5.0, language block it_IT; inference defaults unchanged)
  • MODEL_CARD β€” dataset updated 27h β†’ 28h
  • samples/speaker_0.mp3 β€” regenerated samples from the fixed models

Why

The previously published it_IT-serena-{medium,high} had a training-data defect: words at
the start of a sentence after .?! were spoken with collapsed, nearly inaudible
durations (e.g. "Purtroppo. Domani non posso." β†’ "domani" barely audible, ~120 ms vs
~1 s healthy).

Fix: fine-tuned the v1 checkpoints on an extended dataset
(committa/serena-synthetic-it-28h, 30,842 clips, 28 h β€” the 27 h base plus 1,372
targeted sentence-initial phrases
covering the missing pattern).

Validation

71-sentence regression scan (duration of sentence-initial words vs healthy median of the
same word, ratio < 0.5 = collapse):

run collapsed words
v1 (published) 4/8
v2 medium (this PR) 2/41
v2 high (this PR) 1/41

The remaining flags in v2 are analysis artifacts (all are "domani" after ., verified by
ear as correctly pronounced β€” the audio splitter in the scan mis-segments that word).
No new collapses were introduced: previously-affected words ("come", "il", "sei",
"subito", "posso") are all healthy (ratio β‰₯ 0.88).

Inference defaults are unchanged (noise_scale 0.6 / length_scale 1.0 / noise_w 0.4),
so existing users receive the fix with no configuration change.

Compatibility notes

  • The .onnx.json phoneme_id_map changed (157 β†’ 166 entries): it now reflects the
    piper1-gpl phoneme set of the new models. The pair (onnx + json) must be updated
    together, as done here.
  • Same voice ids (it_IT-serena-medium, it_IT-serena-high), same language/quality/
    sample-rate: no client-side changes required.

Related

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment