|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- hearing loss |
|
- challenge |
|
- signal processing |
|
- source separation |
|
- lyrics intelligibility |
|
- audio |
|
- audio-to-audio |
|
library_name: asteroid |
|
--- |
|
# Cadenza Challenge: CAD2-Task1 |
|
|
|
A NonCausal Lyrics/Accompaniment separation model for the CAD2-Task1 baseline system. |
|
|
|
* Architecture: ConvTasNet (Kaituo XU) with multichannel support (Alexandre Defossez). |
|
* Parameters: |
|
* B: 256 |
|
* C: 2 |
|
* H: 512 |
|
* L: 20 |
|
* N: 256 |
|
* P: 3 |
|
* R: 4 |
|
* X: 10 |
|
* audio_channels: 2 |
|
* causal: false |
|
* mask_nonlinear: relu |
|
* norm_type: gLN |
|
* training: |
|
* sample_rate: 44100 |
|
* samples_per_track: 64 |
|
* segment: 5.0 |
|
* aggregate: 2 |
|
* batch_size: 4 |
|
* early_stop: true |
|
* epochs: 200 |
|
|
|
|
|
## Dataset |
|
The model was trained on the training split of the MUSDB18-HQ dataset. |
|
|
|
## How to use |
|
|
|
``` |
|
from tasnet import ConvTasNetStereo |
|
model = ConvTasNetStereo.from_pretrained( |
|
"cadenzachallenge/ConvTasNet_LyricsSeparation_NonCausal" |
|
).cpu() |
|
``` |
|
|
|
## Results |
|
|
|
| Track | Vocals (SDR) | Accompaniment (SDR) | |
|
|:------|:------------:|:---------:| |
|
| Al James - Schoolboy Facination | 15.006 | 7.893 | |
|
| AM Contra - Heart Peripheral | 21.616 | 8.014 | |
|
| Angels In Amplifiers - I'm Alright | 18.152 | 7.742 | |
|
| Arise - Run Run Run | 28.328 | 7.471 | |
|
| Ben Carrigan - We'll Talk About It All Tonight | 20.789 | 5.218 | |
|
| BKS - Bulldozer | 24.61 | 4.017 | |
|
| BKS - Too Much | 22.342 | 9.79 | |
|
| Bobby Nobody - Stitch Up | 20.559 | 9.151 | |
|
| Buitraker - Revo X | 21.887 | 5.843 | |
|
| Carlos Gonzalez - A Place For Us | 19.358 | 5.231 | |
|
| Cristina Vane - So Easy | 17.977 | 10.211 | |
|
| Detsky Sad - Walkie Talkie | 18.544 | 8.603 | |
|
| Enda Reilly - Cur An Long Ag Seol | 20.317 | -0.04 | |
|
| Forkupines - Semantics | 23.6 | 7.771 | |
|
| Georgia Wonder - Siren | 15.564 | 5.524 | |
|
| Girls Under Glass - We Feel Alright | 27.57 | 4.542 | |
|
| Hollow Ground - Ill Fate | 22.336 | 9.244 | |
|
| James Elder & Mark M Thompson - The English Actor | 19.278 | 5.524 | |
|
| Juliet's Rescue - Heartbeats | 21.802 | 8.428 | |
|
| Little Chicago's Finest - My Own | 6.498 | 5.774 | |
|
| Louis Cressy Band - Good Time | 23.391 | 9.418 | |
|
| Lyndsey Ollard - Catching Up | 20.467 | 9.685 | |
|
| M.E.R.C. Music - Knockout | 12.641 | 9.479 | |
|
| Moosmusic - Big Dummy Shake | 17.662 | 10.024 | |
|
| Motor Tapes - Shore | 18.09 | 6.043 | |
|
| Mu - Too Bright | 16.715 | 10.079 | |
|
| Nerve 9 - Pray For The Rain | 24.028 | 7.481 | |
|
| PR - Happy Daze | 45.118 | 0.37 | |
|
| PR - Oh No | 9.312 | 0.459 | |
|
| Punkdisco - Oral Hygiene | 23.343 | 7.736 | |
|
| Raft Monk - Tiring | 17.245 | 3.306 | |
|
| Sambasevam Shanmugam - Kaathaadi | 19.432 | 10.086 | |
|
| Secretariat - Borderline | 22.836 | 6.729 | |
|
| Secretariat - Over The Top | 26.406 | 8.413 | |
|
| Side Effects Project - Sing With Me | 17.073 | 12.129 | |
|
| Signe Jakobsen - What Have You Done To Me | 16.439 | 9.999 | |
|
| Skelpolu - Resurrection | 27.398 | 0.665 | |
|
| Speak Softly - Broken Man | 21.053 | 6.772 | |
|
| Speak Softly - Like Horses | 13.648 | 7.353 | |
|
| The Doppler Shift - Atrophy | 20.36 | 3.394 | |
|
| The Easton Ellises - Falcon 69 | 11.352 | 6.494 | |
|
| The Easton Ellises (Baumi) - SDRNR | 13.906 | 2.433 | |
|
| The Long Wait - Dark Horses | 21.987 | 7.209 | |
|
| The Mountaineering Club - Mallory | 27.447 | 12.238 | |
|
| The Sunshine Garcia Band - For I Am The Moon | 18.684 | 11.287 | |
|
| Timboz - Pony | 22.435 | 4.517 | |
|
| Tom McKenzie - Directions | 26.247 | 10.277 | |
|
| Triviul feat. The Fiend - Widow | 12.671 | 9.977 | |
|
| We Fell From The Sky - Not You | 26.073 | 5.367 | |
|
| Zeno - Signs | 18.11 | 7.174 | |
|
| **Total (median over frames, median over tracks)** | **5.249** | **11.155** | |
