LeeAeron/YuE2-3B-BF16-Baked

YuE2-3B-BF16 model baked with YuE2-instrumental-cot-full-lora

Merge by LeeAeron

license: cc-by-nc-4.0

base_model:

• m-a-p/YuE2-3B

tags: - audio - music - yue2 - lora - instrumental

AR-branch GGUF baked with LoRa that makes the model write instrumental music with a section plan. Rank 64 on self_attn.{q,k,v,o}_proj + mlp.{gate,up,down}_proj of all 28 layers, trained on ~2.7k instrumental tracks paired with chord-annotated ABC scores from SheetSage2, regularized 50/50 with YuE2's own generations.

Use with cot="full"

This LoRA is meant to run with YuE2's chain-of-thought on (cot="full"): the model first writes its own ABC score, then the music tokens conditioned on that score. It was trained with the score present half the time and absent half the time, so cot="off" still works, but in our renders the score-first path ended songs on its own 8 times out of 9 and sounded more deliberate, while the score-free path either bailed early or ran to the length cap. Set cot="full" in the pipeline call (ComfyUI: the mode input of the YuE2 nodes with a non-empty ABC step; our script: COT=full).

The style field is a normal YuE2 tag string (genre, instruments, mood, BPM). The lyrics field carries the structure, in one of three forms the LoRA was trained on in equal thirds. Use only these bare tag names: intro, verse, pre-chorus, chorus, bridge, outro. One tag per line, real line breaks, nothing else in the brackets.

1. Bare — let the model choose the structure and length.

[instrumental]

2. Untimed tags — you choose the section order, the model chooses the timing.

[intro]
[verse]
[chorus]
[bridge]
[chorus]
[outro]

3. Timed tags — you also give each section a start and end in m:ss. The model was trained with exact section times from real tracks, so this is the strongest structural steer. Treat the times as a guide rather than a guarantee: the model follows the section order and proportions better than the absolute end time, and it tends toward 3–5 minute songs regardless of the plan.

[intro 0:00-0:15]
[verse 0:15-0:45]
[chorus 0:45-1:10]
[bridge 1:10-1:40]
[chorus 1:40-2:05]
[outro 2:05-2:30]

Keep production notes ([guitar solo, distorted]), lyrics text, and literal \n characters out of the lyrics field: the LoRA never saw them and they pull the output away from the trained behavior.

Example

COT=full STYLE_TEXT="dark ambient, water phone, theremin, piano, slow" \
python scripts/ar_generate.py ar_lora_inst_v3abc.safetensors none out_tag any_style_track plan.txt 21

plan.txt holds one of the three caption forms above. AR_SCALE (default 1.0) scales the LoRA delta; lower values give the base model more say.