cstr/chatterbox-nano-GGUF

Chatterbox-Nano TTS — GGUF (ggml)

GGUF / ggml conversion of ResembleAI/chatterbox-nano for use with CrispStrobe/CrispASR (v0.8.31+, issue #382).

Chatterbox-Nano is the small sibling of Chatterbox-Turbo: the same AR text-to-speech pipeline with a GPT2-small T3 backbone (12 layers, 768 hidden, 12 heads) instead of Turbo's GPT2-medium (24L, 1024D). Upstream's s3gen_meanflow.safetensors, ve.safetensors and conds.pt are byte-identical to ResembleAI/chatterbox-turbo (same LFS blobs), so this repo ships only the T3 — use the S3Gen from cstr/chatterbox-turbo-GGUF as the companion. CrispASR's registry does this automatically. Distributed under MIT license.

Files

File	Size	Notes
chatterbox-nano-t3-f16.gguf	476 MB	T3 GPT-2 AR model (12L, 768D) + VE + baked conds
chatterbox-nano-t3-q8_0.gguf	345 MB	Quantized T3, recommended deployment default
chatterbox-nano-t3-q4_k.gguf	283 MB	Smaller T3 quant for memory-constrained use

The GGUF carries chatterbox.t3.n_kv_heads = 12 explicitly (GPT-2 is MHA; CrispASR's built-in default of 16 fits Turbo only). Token ids match upstream inference (T3Config: start_text 255, stop_text 0, speech 6561/6562) — the stop_text_token: 50256 in t3_nano_v1.yaml is a training-time artifact that upstream generate() never reads.

Usage

# auto-download T3 + Turbo S3Gen companion
crispasr --backend chatterbox-nano -m auto --auto-download \
  --tts "Hello from Chatterbox Nano." --tts-output nano.wav

# explicit files
crispasr --backend chatterbox-nano -m chatterbox-nano-t3-q8_0.gguf \
  --codec-model chatterbox-turbo-s3gen-q8_0.gguf \
  --tts "Hello from Chatterbox Nano." --tts-output nano.wav

Voice cloning (--voice reference.wav), the 19 [emotion] style tokens, and the sampler defaults are identical to the Turbo backend; CFG/min_p/exaggeration are not supported by the Turbo/Nano pipeline (upstream disables them).

Conversion

Converted with models/convert-chatterbox-to-gguf.py --variant nano from upstream revision 71ccd1d0; quantized with crispasr-quantize.