nepali-conformer-offline

Full-context Nepali ASR โ€” the strongest open model we measured on real Nepali telephone audio (see the NepTel leaderboard in the repo).

Try it: demo Space ยท Everything else: github.com/Ampixa/nepaliconformer (NepTel benchmark, per-system outputs, full honest results)

Numbers (measured, not marketed)

benchmark WER
NepTel โ€” real Nepali call audio, human-reviewed refs 33.81
Held-out gold read Nepali (W1 slice) 31.5
Whisper-large-v3 zero-shot on the same NepTel audio 99.4

Architecture

121.3M-parameter 17-layer Conformer (d=512, striding ร—4, 40 ms frames), hybrid TDT/CTC decoder, 1,024-piece Devanagari SentencePiece. Full self-attention, offline decoding.

Training data

~1,655 h of mostly conversational Nepali (YouTube podcasts/interviews) with Google Chirp 2 pseudo-labels + 105 h human-labeled read speech; telephony codec, noise, reverb and tempo augmentation. Label-noise ceiling and every measured limitation (English, sung speech, slow speech, end-of-turn) are documented in the repo's RESULTS.md.

Usage

from nemo.collections.asr.models import EncDecHybridRNNTCTCBPEModel
m = EncDecHybridRNNTCTCBPEModel.restore_from("nepali_conformer_offline.nemo")
print(m.transcribe(["audio.wav"])[0].text)

License: CC-BY-NC-4.0 (weights). Code in the repo: MIT.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Space using ampixa/nepali-conformer-offline 1

Evaluation results

  • Real-call WER on NepTel v0.1 (real Nepali call-center audio, human-reviewed)
    self-reported
    33.810
  • Real-call CER on NepTel v0.1 (real Nepali call-center audio, human-reviewed)
    self-reported
    16.630
  • Read-speech WER on Held-out gold read Nepali (W1 read slice, OpenSLR-54 utterances absent from training)
    self-reported
    31.500