# A Closer Look at Latent Representations of End-to-end TTS Models

Martin Lenglet, Olivier Perrotin, Gérard Bailly

► To cite this version:

Martin Lenglet, Olivier Perrotin, Gérard Bailly. A Closer Look at Latent Representations of End-to-end TTS Models. Journée commune AFIA-TLH / AFCP – "Extraction de connaissances interprétables pour l'étude de la communication parlée", Dec 2023, Avignon, France. . hal-04269953

HAL Id: hal-04269953

https://hal.science/hal-04269953v1

Submitted on 23 Jan 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

gipsa-lab

# A closer look at latent representations of end-to-end TTS models

Martin Lenglet, Olivier Perrotin, Gérard Bailly, Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab

## How are acoustic parameters encoded in a model?

<figure><img src="image_3.png" /></figure>

## Can we control them, and how does the system behave?

<figure><img src="image_4.png" /></figure>

► Single linear control, multiple non-linear effects

<figure><img src="image_5.png" /></figure>

<figure><img src="image_6.png" /></figure>

<figure><img src="image_7.png" /></figure>

<figure><img src="image_8.png" /></figure>

Grenoble Image Parole Signal Automatique
UMR CNRS 5216 - Grenoble Campus
38400 Saint Martin d'Hères - FRANCE

<figure><img src="image_9.png" /></figure>

<figure><img src="image_10.png" /></figure>

<figure><img src="image_11.png" /></figure>