Edit model card

:sound: LP-MusicCaps: LLM-Based Pseudo Music Captioning

Demo Video

This is a implementation of LP-MusicCaps: LLM-Based Pseudo Music Captioning. This project aims to generate captions for music. 1) Tag-to-Caption: Using existing tags, We leverage the power of OpenAI's GPT-3.5 Turbo API to generate high-quality and contextually relevant captions based on music tag. 2) Audio-to-Caption: Using music-audio and pseudo caption pairs, we train a cross-model encoder-decoder model for end-to-end music captioning

LP-MusicCaps: LLM-Based Pseudo Music Captioning
SeungHeon Doh, Keunwoo Choi, Jongpil Lee, Juhan Nam
To appear ISMIR 2023


Open Source Material

are available online for future research. example of dataset in notebook

Downloads last month
Unable to determine this model's library. Check the docs .

Datasets used to train seungheondoh/lp-music-caps

Spaces using seungheondoh/lp-music-caps 4

Collection including seungheondoh/lp-music-caps