A weekend project that combines two of my favorite things - LLMs and music visualization. MilkDropLM is an experimental model trained to generate MilkDrop preset scripts, aiming to expand the creative possibilities in the visualization space. If you're familiar with WinAmp, MilkDrop was one of the many spiritual successors that spun out of its visualization features.
-Model Details-
Early alpha release (v0.3) - Trained to generate MilkDrop preset syntax - Based on qwen-2.5-coder-7b due to its math and programming ability - Fine-tuned on 10k+ cream of the crop presets, hand-curated by a MilkDrop vet (shout out @superwatermelon!) - Apache 2.0 licensed
The training process was fascinating - a lot of broader ML questions about this space that you can read all about on the model card.
This is still an early alpha so any feedback is appreciated but I'm excited to share the results with you all.
Feel free to experiment, contribute, or just grab some presets for your next visualization session. PRs and feedback always welcome! Demo notebook and training details in the repo.
PS: A HUGE thank you to my followers old and new - your support does not go unnoticed. It's my absolute honor to share these experiments with you all!