HeartCodec-oss-20260123, fp16

HeartCodec-oss-20260123 with its weights stored in float16 instead of float32: 3.32 GB instead of 6.64 GB.

Changes made by Audante (19.10.2026): the weights of revision f889dab0532cfa4bf459f2a3367eb6d346b8eeda were converted from fp32 to fp16 and saved in one shard; config.json says torch_dtype: float16. No other changes.

Result (heartlib on an Apple M3 Ultra, 30-second songs, fixed seed): decoding in fp16 gives byte-identical audio to the original weights decoded in fp16. Decoding in fp32 from these fp16 weights differs from the fp32 original by 0.13 dB mean mel distance (SNR 30 dB).

Origin and licence. HeartCodec is developed by the HeartMuLa Team and licensed under the Apache License 2.0 (since 20.01.2026: "We update the license of this repo and all related model weights to Apache 2.0", github.com/HeartMuLa/heartlib). The licence text in LICENSE is taken unchanged from heartlib. The original Hugging Face repository states the licence in its metadata and model card. This is not an official HeartMuLa release.

The copy exists so that Audante Link, the desktop helper of the music app Audante, downloads less. The language model in bf16 is at Audante/HeartMuLa-oss-3B-happy-new-year-bf16; tokenizer and generation config come from HeartMuLa/HeartMuLaGen.

Please cite the authors:

@misc{yang2026heartmulafamilyopensourced,
      title={HeartMuLa: A Family of Open Sourced Music Foundation Models}, 
      author={Dongchao Yang and Yuxin Xie and Yuguo Yin and Zheyu Wang and Xiaoyu Yi and Gongxi Zhu and Xiaolong Weng and Zihan Xiong and Yingzhe Ma and Dading Cong and Jingliang Liu and Zihang Huang and Jinghan Ru and Rongjie Huang and Haoran Wan and Peixu Wang and Kuoxi Yu and Helin Wang and Liming Liang and Xianwei Zhuang and Yuanyuan Wang and Haohan Guo and Junjie Cao and Zeqian Ju and Songxiang Liu and Yuewen Cao and Heming Weng and Yuexian Zou},
      year={2026},
      eprint={2601.10547},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2601.10547}, 
}
Downloads last month
18
Safetensors
Model size
2B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Audante/HeartCodec-oss-20260123-fp16

Finetuned
(4)
this model

Paper for Audante/HeartCodec-oss-20260123-fp16