|
--- |
|
tags: |
|
- audio-to-audio |
|
- asteroid |
|
- audio |
|
- audio-source-separation |
|
datasets: |
|
- wham |
|
- sep_clean |
|
license: cc-by-sa-4.0 |
|
--- |
|
|
|
## Asteroid model `mpariente/DPRNNTasNet(ks=16)_WHAM!_sepclean` |
|
|
|
♻️ Imported from https://zenodo.org/record/3903795#.X8pMBRNKjUI |
|
|
|
This model was trained by Manuel Pariente using the wham/DPRNN recipe in [Asteroid](https://github.com/asteroid-team/asteroid). It was trained on the sep_clean task of the WHAM! dataset. |
|
|
|
|
|
### Demo: How to use in Asteroid |
|
|
|
```python |
|
# coming soon |
|
``` |
|
|
|
|
|
### Training config |
|
|
|
- data: |
|
- mode: min |
|
- nondefault_nsrc: None |
|
- sample_rate: 8000 |
|
- segment: 2.0 |
|
- task: sep_clean |
|
- train_dir: data/wav8k/min/tr |
|
- valid_dir: data/wav8k/min/cv |
|
- filterbank: |
|
- kernel_size: 16 |
|
- n_filters: 64 |
|
- stride: 8 |
|
- main_args: |
|
- exp_dir: exp/train_dprnn_ks16/ |
|
- help: None |
|
- masknet: |
|
- bidirectional: True |
|
- bn_chan: 128 |
|
- chunk_size: 100 |
|
- dropout: 0 |
|
- hid_size: 128 |
|
- hop_size: 50 |
|
- in_chan: 64 |
|
- mask_act: sigmoid |
|
- n_repeats: 6 |
|
- n_src: 2 |
|
- out_chan: 64 |
|
- optim: |
|
- lr: 0.001 |
|
- optimizer: adam |
|
- weight_decay: 1e-05 |
|
- positional arguments: |
|
- training: |
|
- batch_size: 6 |
|
- early_stop: True |
|
- epochs: 200 |
|
- gradient_clipping: 5 |
|
- half_lr: True |
|
- num_workers: 6 |
|
|
|
#### Results |
|
|
|
- `si_sdr`: 18.227683982688003 |
|
- `si_sdr_imp`: 18.22883576588251 |
|
- `sdr`: 18.617789605060587 |
|
- `sdr_imp`: 18.466745426438173 |
|
- `sir`: 29.22773720052717 |
|
- `sir_imp`: 29.07669302190474 |
|
- `sar`: 19.116352171914485 |
|
- `sar_imp`: -130.06009796503054 |
|
- `stoi`: 0.9722025377865715 |
|
- `stoi_imp`: 0.23415680987800583 |
|
|
|
### Citing Asteroid |
|
|
|
```BibTex |
|
@inproceedings{Pariente2020Asteroid, |
|
title={Asteroid: the {PyTorch}-based audio source separation toolkit for researchers}, |
|
author={Manuel Pariente and Samuele Cornell and Joris Cosentino and Sunit Sivasankaran and |
|
Efthymios Tzinis and Jens Heitkaemper and Michel Olvera and Fabian-Robert Stöter and |
|
Mathieu Hu and Juan M. Martín-Doñas and David Ditter and Ariel Frank and Antoine Deleforge |
|
and Emmanuel Vincent}, |
|
year={2020}, |
|
booktitle={Proc. Interspeech}, |
|
} |
|
``` |
|
|
|
Or on arXiv: |
|
|
|
```bibtex |
|
@misc{pariente2020asteroid, |
|
title={Asteroid: the PyTorch-based audio source separation toolkit for researchers}, |
|
author={Manuel Pariente and Samuele Cornell and Joris Cosentino and Sunit Sivasankaran and Efthymios Tzinis and Jens Heitkaemper and Michel Olvera and Fabian-Robert Stöter and Mathieu Hu and Juan M. Martín-Doñas and David Ditter and Ariel Frank and Antoine Deleforge and Emmanuel Vincent}, |
|
year={2020}, |
|
eprint={2005.04132}, |
|
archivePrefix={arXiv}, |
|
primaryClass={eess.AS} |
|
} |
|
``` |
