Hugging Face's logo

amphion
/
valle_libritts

English
Model card Files Community
valle_libritts / README.md
lmxue's picture
lmxue
Update README.md
67df832
preview code
|
raw
history blame
1.79 kB
metadata
license: mit
language:
  - en

Pretrained Model of Amphion Vall-E

We provide the pre-trained checkpoint of Vall-E trained on LibriTTS, which is is a multi-speaker English corpus of approximately 585 hours of read English speech at 24kHz.

Quick Start

To utilize the pretrained models, just run the following commands:

Step1: Download the checkpoint 

git lfs install
git clone https://huggingface.co/amphion/valle-libritts

Step2: Clone the Amphion's Source Code of GitHub 

git clone https://github.com/open-mmlab/Amphion.git

Step3: Specify the checkpoint's path

Use the soft link to specify the downloaded checkpoint in the first step:

cd Amphion
mkdir -p ckpts/tts
ln -s  ../../../valle-libritts  ckpts/tts/

Step4: Inference

You can follow the inference part of this recipe to generate speech from text. For example, if you want to synthesize a clip of speech with the text of "This is a clip of generated speech with the given text from Amphion Vall-E model.", just, run:

sh egs/tts/VALLE/run.sh --stage 3 --gpu "0" \
    --config "ckpts/tts/valle-libritts/args.json" \
    --infer_expt_dir Amphion/ckpts/tts/valle-libritts \
    --infer_output_dir Amphion/ckpts/tts/valle-libritts/result \
    --infer_mode "single" \
    --infer_text "This is a clip of generated speech with the given text from Amphion Vall-E model." \
    --infer_text_prompt "But even the unsuccessful dramatist has his moments." \
    --infer_audio_prompt egs/tts/VALLE/prompt_examples/7176_92135_000004_000000.wav