thepatch/vanya_ai_dnb_0.1-GGUF

vanya_ai_dnb_0.1 GGUF

GGUF conversion of thepatch/vanya_ai_dnb_0.1, a drum and bass finetune of MusicGen small, for audiocraft.cpp's native musicgen-server, which runs gary4local's C++ gary service.

Pick one precision of the language model and put it in a folder with the EnCodec and T5 files. If more than one precision is in the folder, the server runs the most precise. Every quantized tensor round-trips against the F16 conversion at cosine 0.9999 or better for Q8_0 and 0.9963 or better for Q4_K_M.

File	Size
musicgen-vanya-dnb-0.4B-v1.0-F16.gguf	802 MiB	F16; the reference
musicgen-vanya-dnb-0.4B-v1.0-Q8_0.gguf	426 MiB	Q8_0 throughout
musicgen-vanya-dnb-0.4B-v1.0-Q4_K_M.gguf	267 MiB	Q4_K, with the FFN down projection, cross-attention K/V, codebook embeddings and output heads at Q6_K
encodec-32khz-v1.0-F32.gguf	221 MiB	MusicGen's 32 kHz EnCodec
t5-base-encoder-0.1B-v1.0-F16.gguf	210 MiB	T5-base text encoder for descriptions

$env:AC_DEVICE = "cuda"
musicgen-server --port 8000 --models-dir C:\path\to\this\folder

The server lists the model in /api/models as thepatch/vanya_ai_dnb_0.1 and accepts that name as model_name, the same routes gary4juce uses with the Python service. See SERVICES.md.

Sources and licensing

• Language model: thepatch/vanya_ai_dnb_0.1 revision 9531a3c97a27, a finetune of facebook/musicgen-small, converted to F16 and quantized with audiocraft.cpp's ac-quantize.
• EnCodec: MusicGen's 32 kHz compression model, facebook/encodec_32khz.
• T5 encoder: google-t5/t5-base revision a9723ea7f1b39c1eae772870f3b547bf6ef7e6c1, Apache 2.0.

MusicGen's weights are released by Meta under CC-BY-NC 4.0, and this finetune and its conversion inherit that license: non-commercial use only. T5-base is Apache 2.0. Each GGUF records its own source and license in its general.* metadata.