hcX02/echora-mms-300m-multilingual-lyrics-forced-aligner

Echora MMS 300M Multilingual Lyrics Forced Aligner

A multilingual forced-alignment model for producing timed lyrics and karaoke segments from music audio and supplied lyric text.

Model Details

• Model type: Wav2Vec2 / MMS CTC forced aligner
• Base model: facebook/mms-300m
• Languages: English, Japanese, Korean, Spanish, Indonesian, Urdu, Hindi, and mixed-script lyrics
• Parameters: Approximately 300M

Intended Use

Use this model to align user-supplied lyric text with audio and produce approximate word or syllable timestamps for personal karaoke and lyric-display projects.

Use Restrictions

Personal, non-commercial use only.

Do not use this model for commercial products, paid services, redistribution, or training other models. You are responsible for ensuring that you have the necessary rights to the audio and lyric text you process.

No permission is granted for copyright-sensitive, rights-restricted, or otherwise unauthorized use.

Limitations

• Timing quality varies depending on vocal clarity, instrumental density, recording quality, language, and lyric accuracy.
• Repeated phrases, long vocal holds, ad-libs, rap, vocal effects, and overlapping vocals may produce inaccurate boundaries.
• Romanized lyrics may have weaker syllable boundaries than lyrics written in their native scripts.

Getting Started

from transformers import Wav2Vec2ForCTC, Wav2Vec2Processor

model_id = "hackslashX/echora-mms-300m-multilingual-lyrics-forced-aligner"

processor = Wav2Vec2Processor.from_pretrained(model_id)
model = Wav2Vec2ForCTC.from_pretrained(model_id)

This repository provides model weights only. Use a compatible forced-alignment pipeline to combine acoustic emissions with the supplied lyric text.

Training

This model was fine-tuned for multilingual lyric forced alignment using timed lyric supervision.

Training configuration, checkpoint selection, and evaluation details are maintained by Echora.

Evaluation

Validation uses lyric-frame accuracy against held-out timed lyric segments. This metric measures agreement with timed labels and does not guarantee perceptually correct karaoke timing.

Contact

Open an issue in the Echora repository.