Deep Performer: Score-to-Audio Music Performance Synthesis (ICASSP 2022)
Channel: Hao-Wen (Herman) Dong 董皓文
Date: 2022-04-21

"Deep Performer: Score-to-Audio Music Performance Synthesis," IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023

Slides: https://salu133445.github.io/deepperformer/pdf/deepperformer_icassp2022_slides.pdf

Hao-Wen Dong, Cong Zhou, Taylor Berg-Kirkpatrick and Julian McAuley, "Deep Performer: Score-to-Audio Music Performance Synthesis," IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.

Paper: https://arxiv.org/abs/2202.06034
Demo: https://salu133445.github.io/deepperformer/

Date: May 22, 2022

0:00 Introduction
0:29 Music performance synthesis
1:09 Challenges
2:15 Prior work
3:31 Overview
4:23 Alignment model
5:47 Synthesis model
7:08 Proposed mechanisms
8:51 Inversion model
9:28 Bach Violin Dataset
10:32 Implementation details
10:46 Demo
11:54 Comparisons to baseline
12:25 Note-wise positional encoding
13:03 Subjective listening test
13:31 Future work
14:26 Conclusion