Add qwen3 tts
Author: ShahVandit
Pull request: yes
Labels: name: New model

name: Audio

<!-- ci-dashboard-badge:start -->
[![CI](https://transformers-ci.lor-e.huggingface.cool/badge/pr?pr=44517)](https://transformers-ci.lor-e.huggingface.cool/d/pytest-observability-by-pr/pytest-observability-branch?var-pr=44517)
<!-- ci-dashboard-badge:end -->

## What does this PR do?

Adds Qwen3-TTS, a series of text-to-speech models by the Qwen team (Alibaba Group), to Transformers.

**Architecture:**
- `Qwen3TTSForConditionalGeneration` — text to multi-codebook speech codes (talker)
- `Qwen3TTSTokenizerV2Model` (12Hz) and `Qwen3TTSTokenizerV1Model` (25Hz) — codes to audio waveform
- `Qwen3TTSProcessor` — text preprocessing

**Features:** voice presets, voice design via natural language, batch inference, 10 languages

**Paper:** [Qwen3-TTS Technical Report](https://arxiv.org/abs/2601.15621)

## Before submitting
- [x] Did you read the [contributor guideline](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md#create-a-pull-request), Pull Request section?
- [x] Did you make sure to update the documentation with your changes?
- [x] Did you write any new necessary tests?

## Who can review?

@eustlb @ebezzam @vasqu

Comments:
@ShahVandit any update on this? Happy to take this up if you don’t have bandwidth.


Hi @AlanPonnachan Thanks for asking! I'm almost done, just wrapping up the integration tests and a few cleanup items. Should have it ready soon.

Hi @ebezzam , the single codebook is not complete and will be added in a follow-up, it also doesn't have an existing checkpoint yet. For the main model and multicodebook, reproducer scripts and integration tests are in place. One thing worth noting: the main model test only compares codes[0, :6] against the original, beyond that the outputs diverge. Open to suggestions on how to handle this.

View the CircleCI Test Summary for this PR:

https://huggingface.co/spaces/transformers-community/circle-ci-viz?pr=44517&sha=2041c2

hi @ShahVandit, just got back from some time off and I'll try to give you some feedback by next week! thanks for your contribution 🙏 

Hi @ShahVandit, if there's anything I can help with on this MR, please let me know. I'd be happy to contribute to the PR.

**[For maintainers]** Suggested jobs to run (before merge)

run-slow: auto, qwen3_tts, qwen3_tts_tokenizer_multi_codebook, qwen3_tts_tokenizer_single_codebook

<!-- ci-dashboard-recap:start -->

---

### CI recap

**Dashboard:** [View test results in Grafana](https://transformers-ci.lor-e.huggingface.cool/d/pytest-observability-by-pr/pytest-observability-branch?var-pr=44517)
**Latest run:** [28541115091:2](https://github.com/huggingface/transformers/actions/runs/28541115091)
**Result:** `failure` | **Jobs:** 2 | **Tests:** 4 | **Failures:** 2 | **Duration:** 20s

> **Code quality check failed**: test jobs were skipped. Fix the code quality issues and push again to run tests.

<!-- ci-dashboard-recap:end -->

Hi @ebezzam, I've pushed the updated code with the requested changes.

I haven't updated `convert_qwen3_tts_to_hf.py` or the slow integration tests yet, since there may be further changes based on review. I'll update those once the model code and state dict layout are finalized.