File size: 1,832 Bytes
78f869b
 
30eb7cf
 
78f869b
30eb7cf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f537952
30eb7cf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
---
license: mit
language:
- en
---

# Pretrained Model of Amphion Vall-E

We provide the pre-trained checkpoint of [Vall-E](https://github.com/open-mmlab/Amphion/tree/main/egs/tts/VALLE) trained on [Libri-light](https://ai.meta.com/tools/libri-light/), which is derived from open-source audio books from the LibriVox project and contains over 60K hours of audio.
Here we processed about 6,000-hour data to train Vall-E.



## Quick Start

To utilize the pre-trained models, just run the following commands:

### Step1: Download the checkpoint
```bash
git lfs install
git clone https://huggingface.co/amphion/valle_librilight_6k
```

### Step2: Clone the Amphion's Source Code of GitHub
```bash
git clone https://github.com/open-mmlab/Amphion.git
```

### Step3: Specify the checkpoint's path
Use the soft link to specify the downloaded checkpoint in the first step:

```bash
cd Amphion
mkdir -p ckpts/tts
ln -s  ../../../valle_librilight_6k  ckpts/tts/
```

### Step4: Inference

You can follow the inference part of [this recipe](https://github.com/open-mmlab/Amphion/tree/main/egs/tts/VALLE#4-inference) to generate speech from text. For example, if you want to synthesize a clip of speech with the text of "This is a clip of generated speech with the given text from Amphion Vall-E model.", just, run:

```bash
sh egs/tts/VALLE/run.sh --stage 3 --gpu "0" \
    --config "ckpts/tts/valle_librilight_6k/args.json" \
    --infer_expt_dir ckpts/tts/valle_librilight_6k \
    --infer_output_dir ckpts/tts/valle_librilight_6k/result \
    --infer_mode "single" \
    --infer_text "This is a clip of generated speech with the given text from Amphion Vall-E model." \
    --infer_text_prompt "But even the unsuccessful dramatist has his moments." \
    --infer_audio_prompt egs/tts/VALLE/prompt_examples/7176_92135_000004_000000.wav
```