README.md

---
# For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=1
# Doc / guide: https://huggingface.co/docs/hub/model-cards
{}
---

# POP2PIANO

Pop2Piano, a Transformer network that generates piano covers given waveforms of pop
music.
# Model Details

Pop2Piano was proposed in the paper [Pop2Piano : Pop Audio-based Piano Cover Generation](https://arxiv.org/abs/2211.00895) by Jongho Choi and Kyogu Lee.

Inspired by [T5](https://arxiv.org/abs/1910.10683), Pop2Piano
is the first model to generate a piano cover directly from pop audio without using melody and
chord extraction modules.

## Model Sources

- [**Original Repository**](https://github.com/sweetcocoa/pop2piano)
- [**Paper**](https://arxiv.org/abs/2211.00895)
- [**Demo**]# TODO (after the ongoing PR is merged)

# Usage

First, install the required packages:

```
pip install --upgrade transformers
```

## Pop music to Piano

 TODO (after the ongoing PR is merged)

## Example 

### Pop Music

<audio controls>
    <source src="https://datasets-server.huggingface.co/assets/sweetcocoa/pop2piano_ci/--/sweetcocoa--pop2piano_ci/test/0/audio/audio.mp3" type="audio/mpeg">
Your browser does not support the audio element.
</audio>

### Generated MIDI

TODO (after the MIDI version is uploaded to the same repo above)

## Tips

 TODO


# Citation

**BibTeX:**
```
@misc{choi2023pop2piano,
      title={Pop2Piano : Pop Audio-based Piano Cover Generation}, 
      author={Jongho Choi and Kyogu Lee},
      year={2023},
      eprint={2211.00895},
      archivePrefix={arXiv},
      primaryClass={cs.SD}
}
```