ashwmurt/neutts_2e

NeuTTS-2E: On-device emotional text-to-speech language model with seven emotions

NeuTTS-2E is a compact on-device emotional text-to-speech language model from Neuphonic. It pairs a 236M-parameter Qwen3 causal LM backbone with the NeuCodec 50Hz neural audio codec, and produces natural-sounding 24kHz English speech for four fixed speakers across seven emotions. Unlike NeuTTS-Nano it does not clone voices; each speaker ships as pre-encoded reference codes, so no reference audio is read and the codec's encoder is never used. The backbone exports as two graphs (a 128-token prefill and a single-token decode) linked into one weight-shared context binary; prompt assembly, emotion conditioning, sampling and NeuCodec decode run on CPU in the app.

This is based on the implementation of NeuTTS-2E found here. This is a standalone recipe compatible with the Qualcomm® AI Hub Models CLI — it can be compiled and evaluated on real Snapdragon devices via Qualcomm® AI Hub Workbench.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Setup

1. Install the package

Install the base package, fetch this recipe from Hugging Face, then use the qai-hub-models CLI to install the recipe's dependencies:

# NOTE: 3.10 <= PYTHON_VERSION < 3.14 is supported.
pip install qai-hub-models
qai-hub-models register ashwmurt/neutts_2e
qai-hub-models install neutts_2e

register downloads the recipe and names it neutts_2e, which is how every command below refers to it.

2. Configure Qualcomm® AI Hub Workbench

Sign-in to Qualcomm® AI Hub Workbench with your Qualcomm® ID. Once signed in navigate to Account -> Settings -> API Token.

With this API token, you can configure your client to run models on the cloud hosted devices.

qai-hub configure --api_token API_TOKEN

Navigate to docs for more information.

Run CLI Demo

Run the following simple CLI demo to verify the model is working end to end:

qai-hub-models demo neutts_2e

More details on the CLI tool can be found with the --help option. See demo.py for sample usage of the model including pre/post processing scripts.

Export for on-device deployment

To run the model on Qualcomm® devices, you must export the model for use with an edge runtime such as TensorFlow Lite, ONNX Runtime, or Qualcomm AI Engine Direct. Use the following command to export the model:

qai-hub-models export neutts_2e

Additional options are documented with the --help option.

License

• The license for the original implementation of NeuTTS-2E can be found here.

References

• NeuCodec Neural Audio Codec for Speech Language Models
• Source Model Implementation

Community

• Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
• For questions or feedback please reach out to us.