MOSS-Music-8B-Instruct (bitsandbytes NF4)

Derived from a copy of OpenMOSS-Team/MOSS-Music-8B-Instruct at revision fce7f8304e96cc2d3398b8106456cbb2ecec3139, by OpenMOSS. This is not an official release.

Changes

The language model quantised to 4 bit (bitsandbytes NF4) and saved; the audio encoder and adapters stay bf16. No retraining.

Licence

Apache License 2.0, as the source โ€” see LICENSE.

All rights to the model remain with its authors. SHA256SUMS, where present, lists the checksum of every file.

Downloads last month
14
Safetensors
Model size
9B params
Tensor type
BF16
ยท
U8
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Audante/MOSS-Music-8B-Instruct-bnb-nf4

Quantized
(6)
this model