Formosan ASR — Bunun

This is FormosanBank's current general-purpose automatic speech recognition checkpoint for Bunun. It was selected by the lowest normalized micro word error rate among the completed language-level TACL systems evaluated on the same frozen all-corpora test partition.

Model

  • Repository: FormosanBank/formosan-asr-bunun
  • Architecture family: XLS-R 53
  • Training path: train-only pan-Formosan continued pretraining, pan-Formosan supervised fine-tuning, and language adaptation
  • Base model: facebook/wav2vec2-large-xlsr-53
  • Parameters are stored in model.safetensors

Training lineage

  1. Base checkpoint: facebook/wav2vec2-large-xlsr-53.
  2. Continued self-supervised pretraining on the frozen pan-Formosan training partition only; development and test audio were excluded.
  3. Supervised pan-Formosan ASR training, then adaptation to the target language's pooled training corpora.

The target-language supervised stage used ILRDF, NTU, ePark1, ePark2, ePark3. The experiment used dataset_v1, frozen split_v2, normalization formosan_safe_v1, and seed 13. Full machine-readable provenance is included in training_config.json.

Evaluation

Evaluation uses the frozen, leakage-controlled split_v2 test manifests and normalized text. Metrics are computed by summing edit counts across all available Bunun test corpora, so larger corpora contribute in proportion to their reference tokens.

  • Normalized micro WER: 19.83%
  • Normalized micro CER: 4.41%
  • Test utterances: 2,729
  • Test corpora: 5
  • Automated readiness: pass
Corpus Utterances WER CER
ILRDF 868 15.70% 5.34%
NTU 86 47.21% 13.80%
ePark1 347 29.13% 4.66%
ePark2 377 16.93% 2.12%
ePark3 1051 18.25% 3.52%

Detailed edit counts are provided in evaluation_results.json and metrics_by_corpus.tsv.

These figures are specific to the frozen TACL evaluation protocol. They should not be compared directly with the April 2026 stage-one releases, which used a different experiment snapshot.

Usage

from transformers import pipeline

repo_id = "FormosanBank/formosan-asr-bunun"
transcribe = pipeline("automatic-speech-recognition", model=repo_id)
result = transcribe("path/to/16khz_audio.wav")
print(result["text"])

For long recordings, segment the audio before inference. The training recipe used utterances between 2 and 20 seconds.

Intended use

This checkpoint supports research, education, language documentation, and revitalization work involving Bunun. Human review is recommended before using transcriptions in archives, publications, teaching materials, or other consequential settings.

Limitations

Performance varies substantially across corpora, speakers, recording conditions, dialects, speaking styles, and orthographic conventions. The aggregate score can hide weak performance on a particular corpus. The model may omit, substitute, or hallucinate words and should not be treated as an authoritative transcription source.

Data provenance

Training and evaluation artifacts come from the frozen Hunter Formosan TACL pipeline. Source corpus IDs can include Bible, ILRDF, NTU, ePark1, ePark2, ePark3, Xuan, YeddaPalemeqBlog, Youtube, and YutasWilang, depending on language availability. Audio is not redistributed in this repository. Underlying recordings retain their original rights and access conditions.

License and attribution

This model release and FormosanBank annotations/metadata are provided under CC BY 4.0. The upstream facebook/wav2vec2-large-xlsr-53 checkpoint is distributed under Apache 2.0. Users remain responsible for respecting the terms associated with underlying source recordings.

Please cite FormosanBank:

@misc{mohamed2024formosanbank,
  author = {Mohamed, W. and Le Ferrand, É. and Sung, L.-M. and Prud'hommeaux, E. and Hartshorne, J. K.},
  title = {FormosanBank},
  year = {2024},
  note = {Electronic Resource},
  url = {https://ai4commsci.gitbook.io/formosanbank}
}
Downloads last month
-
Safetensors
Model size
0.3B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for FormosanBank/formosan-asr-bunun

Finetuned
(366)
this model

Space using FormosanBank/formosan-asr-bunun 1

Collection including FormosanBank/formosan-asr-bunun