Automatic Speech Recognition
WhisperKit
Core ML
Korean
whisper

whisper-base-ko (WhisperKit Core ML)

Korean fine-tune of openai/whisper-base (revision e37978b90ca9030d5170a5c07aadb050351a65bb), converted to Core ML for WhisperKit with whisperkittools 84f77a83c8f530022ae55fbb1a64b3351ef63c7a. Used by the Nogmi app for on-device Korean transcription. Folder: nogmi_whisper-base-ko-v1/.

Training data

All data is publicly licensed for redistribution of derived models and commercial use:

  • FLEURS (Conneau et al., 2022), Google β€” google/fleurs@70bb2e84b976b7e960aa89f1c648e09c59f894dd, CC-BY-4.0 (https://huggingface.co/datasets/google/fleurs)
  • Zeroth-Korean (OpenSLR 40), Atlas Guide Inc. / Gridspace β€” Bingsu/zeroth-korean@bd173fe2c8ed0dccd47acb4eda77542593651622, CC-BY-4.0 (https://www.openslr.org/40/)
  • Mozilla Common Voice 17.0 (ko), via HF mirror fsicoli/common_voice_17_0 β€” fsicoli/common_voice_17_0@8262c16bf297c87a9cd88c51997c4758ed7a8ba2, CC0-1.0 (https://commonvoice.mozilla.org)

Common Voice terms: you must not attempt to determine the identity of speakers in the dataset. No KsponSpeech / AIHub data and no user recordings were used. Training: full fine-tune, lr 2e-06, 100 steps, batch 16Γ—1, 18% multilingual replay (FLEURS).

Evaluation (held-out, never trained on; CER/WER in %, NFKC, punctuation and spaces removed for CER)

set original CER this model CER original WER this model WER
fleurs_ko_test 16.176 6.357 33.115 17.015
cv17_ko_test 28.566 13.126 62.17 30.302
zeroth_ko_test 17.259 8.135 46.108 28.249
fleurs_en_test 4.833 111.152 10.393 125.127
fleurs_ja_test 25.107 108.389 101.111 500.404

Original numbers were re-measured with the same script on the same rows (greedy decoding). Core ML vs PyTorch CER delta: fleurs_ko_test +0.0pp, cv17_ko_test +0.0pp.

The long-form (meeting-like) regression check was waived for this release: no internal long-form set was available.

License

Model weights: Apache-2.0 (as the base model). Attribution for CC-BY-4.0 data is given above and in NOTICE.md.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for okdohyuk/whisper-base-ko-coreml

Finetuned
(804)
this model

Datasets used to train okdohyuk/whisper-base-ko-coreml