README.md

metadata

title: PicturesOfMIDI
emoji: 🎹
colorFrom: blue
colorTo: gray
sdk: gradio
sdk_version: 4.37.1
app_file: app.py
pinned: false
license: mit

Spaces demo of "Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting" by Scott H. Hawley

Paper: https://arxiv.org/abs/2407.01499

Website with examples & more discussion: https://picturesofmidi.github.io/PicturesOfMIDI/

Demo Instructions:

Choose from the examples at the bottom, and/or use the 'draw' tool draw shapes to inpaint with notes. White denotes regions to inpaint.

Iterative Workflow Idea: Once the output image is generated, download it and upload it as a new input image, edit via drawing, then re-run the model! (I call this "ReMasking".)