File size: 1,175 Bytes
34f2a94
 
7784ed2
 
 
34f2a94
7784ed2
5d6f6a7
 
 
 
7784ed2
 
b2e6b03
7784ed2
 
 
 
 
 
 
 
 
 
 
 
32b5aeb
7784ed2
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
---
license: cc-by-4.0
language:
- ru
library_name: nemo
---

### How to use

See example in this [notebook](https://github.com/bene-ges/nemo_compatible/blob/main/notebooks/Russian_TTS_with_IPA_G2P_FastPitch_and_HifiGAN.ipynb). It contains the inference pipeline for  G2P + FastPitch + Hifigan.

### Input

This model expects text converted to IPA-like transcriptions. See this [g2p model](https://huggingface.co/bene-ges/ru_g2p_ipa_bert_large) for conversion of plain Russian text to phonemes.
If you feed plain text directly, it will work, but quality will be low.

### Output

This model generates mel spectrograms.

## Training

The NeMo toolkit [1] was used for training the model for 1000+ epochs.

### Datasets

This model is trained on [RUSLAN](https://ruslan-corpus.github.io/) [2] corpus (single speaker, male voice) sampled at 22050Hz.


## References
- [1] [NVIDIA NeMo Toolkit](https://github.com/NVIDIA/NeMo)
- [2] Gabdrakhmanov L., Garaev R., Razinkov E. (2019) RUSLAN: Russian Spoken Language Corpus for Speech Synthesis. In: Salah A., Karpov A., Potapova R. (eds) Speech and Computer. SPECOM 2019. Lecture Notes in Computer Science, vol 11658. Springer, Cham