DAC 44.1 kHz (decoder)

Descript Audio Codec at 44.1 kHz, decode half, exported for loom.cpp. Family 11: codec tokens in, a waveform out.

This is a loom.cpp export: a single self-describing GGUF that carries its own graph topologies, tokenizer (if any) and driver script, produced by loom-exporter.

Original model

Exported from descript/dac_44khz. Weights are unmodified; this repo packages the same parameters into loom.cpp's GGUF format.

License

mit, inherited from the base model above.

Language(s)

(none tagged upstream)

a codec, not a language model: it carries no vocabulary and no language. The upstream HF repo carries no license: tag; MIT is from the project's own LICENSE and its README's explicit statement about the weights.

Usage

Run it with loom-py -- loom-py-rt on PyPI:

pip install -U "loom-py-rt[hub]"
import loom

model = loom.Model.from_pretrained("loom-ai-org/dac-44khz-loom")

# The geometry a caller needs, declared by the file rather than looked up in a paper:
n_codebooks = model.hparam("codec.n_codebooks")       # code streams per frame
codebook_size = model.hparam("codec.codebook_size")   # valid id range per stream
frame_rate = model.hparam("codec.frame_rate", "f32")  # codes per second
print(n_codebooks, codebook_size, frame_rate, model.contract["sample_rate"])

# Codes are FRAME-MAJOR: all `n_codebooks` codes for frame 0, then frame 1, and so on. This file
# is the DECODE half -- real codes come from the matching encoder, or an AR model that emits them.
frames = round(frame_rate)                            # one second of audio
codes = [[0] * n_codebooks for _ in range(frames)]
audio = model.codes2speech.infer(codes)
print(len(audio), "samples at", audio.sample_rate, "Hz =", round(audio.duration, 3), "s")
audio.save("out.wav")

# A flat list works too, and is what a driver that emitted the codes hands over. One that is not a
# whole number of frames is refused rather than reinterpreted at a different width.
audio = model.codes2speech.infer([0] * (frames * n_codebooks))

The layer underneath

The call above is the high-level door: one per task, named for the modality pair it maps between, with the windowing, sampling and assembly this model needs already applied. Under it, model.infer(...) passes your arguments straight to the driver this GGUF embeds -- which is where you go for a knob the door does not name.

model.driver_source prints that driver, including a header comment documenting every argument it accepts for this model, and is the authority on it. See loom-py for the API and loom.cpp for what the engine does between the two.

Known limitations

This is the DECODE half only. encode is audio-in/codes-out -- a different contract with a different modality pair -- and no model that decodes through this codec ever calls it, so exporting it would be weight in the file for a door nothing opens. To go the other way, use the upstream checkpoint.

It takes 9 code streams per frame at 86.13 frames per second, and one frame decodes to 512 samples. Codes from a different codec -- or from DAC at a different sample rate -- are integers in the right range and produce noise rather than an error.

It does not undo a delay pattern. An AR model that emits these codes typically offsets stream k by k steps; realigning them is a property of that model, not of the codec, so feed it aligned codes.

Files

  • dac-44khz.gguf -- the model, exported with loom-exporter.
Downloads last month
23
GGUF
Model size
54.3M params
Architecture
loom-dac
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for loom-ai-org/dac-44khz-loom

Quantized
(3)
this model

Collection including loom-ai-org/dac-44khz-loom