mlx-community/MOSS-Audio-Tokenizer-v2-bf16

MLX conversion of OpenMOSS-Team/MOSS-Audio-Tokenizer-v2 (OpenMOSS) โ€” the 48 kHz stereo neural audio codec behind MOSS-TTS-Local-Transformer-v1.5: causal windowed transformer encoder/decoder with a residual LFQ quantizer (32 codebooks ร— 1024, 12.5 frames/s, downsample_rate 3840 per channel).

Precision: bf16 (the upstream compute_dtype; the upstream file is fp32, 8.5 GB โ†’ 4.3 GB here). Single model.safetensors with the key names mlx-audio's MossAudioTokenizer loads directly (linear1/2 โ†’ ffn.0/2, in_projs.0 โ†’ in_proj, โ€ฆ); config.json is the upstream config minus auto_map. Round-trip verified with mlx-audio (encode โ†’ decode of a 10 s clip).

Use with mlx-audio

from mlx_audio.codec.models.moss_audio_tokenizer import MossAudioTokenizer
tok = MossAudioTokenizer.from_pretrained("mlx-community/MOSS-Audio-Tokenizer-v2-bf16")
codes = tok.encode_audio("speech.wav", num_quantizers=12)     # [frames, nq] int32
audio = tok.decode_audio_codes(codes, num_quantizers=12)       # [samples, 2] float32 @ 48 kHz

Pass audio_tokenizer_source="mlx-community/MOSS-Audio-Tokenizer-v2-bf16" to MOSS-TTS-Local-Transformer-v1.5 generation to use this mirror instead of the upstream fp32 repo.

License

Apache-2.0 (upstream weights and this conversion). Please credit OpenMOSS for the model.

Downloads last month
-
Safetensors
Model size
2B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mlx-community/MOSS-Audio-Tokenizer-v2-bf16

Finetuned
(3)
this model