aiface's picture
Upload 12 files
327b68f
|
raw
history blame
999 Bytes
### Pre-processing
* To get mouth ROIs
Run mouth cropping script to save grayscale mouth ROIs. We assume you save cropped mouths to *`$TCN_LIPREADING_ROOT/datasets/visual_data/`*. You can choose `--testset-only` to produce testing set.
```Shell
python crop_mouth_from_video.py --video-direc <LRW-DIREC> \
--landmark-direc <LANDMARK-DIREC> \
--save-direc <MOUTH-ROIS-DIRECTORY> \
--convert-gray \
--testset-only
```
* To get audio waveforms
Run format conversion script to extract audio waveforms (.npz) from raw videos. We assume you save audio waveforms to *`$TCN_LIPREADING_ROOT/datasets/audio_data/`*. You can choose `--testset-only` to produce testing set.
```Shell
python extract_audio_from_video.py --video-direc <LRW-DIREC> \
--save-direc <AUDIO-WAVEFORMS-DIRECTORY> \
--testset-only
```