gustapoll/tts-xavante

MMS Xavante TTS (LoRA)

A LoRA adapter (r=8, alpha=16, targeting q_proj/v_proj) fine-tuning facebook/mms-tts-fin for text-to-speech (TTS) in Xavante, a Brazilian indigenous language. Trained with a combined CTC + cycle-consistency (TTS resynthesis) + mel-reconstruction loss as part of the ablation variant no_cycle.

Note: Xavante is not in MMS's native language set. This adapter was bootstrapped from MMS's fin checkpoint (facebook/mms-tts-fin) as the closest available base, then fine-tuned on Xavante data.

Non-commercial use only

The base MMS model is licensed CC-BY-NC-4.0. This adapter inherits that restriction: non-commercial use only.

Quality caveat

This is an early-stage, low-resource fine-tune, evaluated on a small held-out set (n=122):

Metric	In-space	Out-of-space
CER	0.510	0.487
MCD	1136.6	1115.7

Treat outputs as a research demo, not production-quality transcription/synthesis.

Try it live

gustapoll/xavante-demo — a Gradio Space with both ASR and TTS tabs for Xavante, also callable as an API via gradio_client.

How to use

from transformers import VitsModel, AutoTokenizer
from peft import PeftModel

base = VitsModel.from_pretrained("facebook/mms-tts-fin")

model = PeftModel.from_pretrained(base, "REPO_ID").eval()
tokenizer = AutoTokenizer.from_pretrained("REPO_ID")