whisper-medium-arabic-dialectal-v2

v2 โ€” openai/whisper-medium (769M) fine-tuned for multi-dialect Arabic on the dialect-balanced dataset oddadmix/lahgtna-v3-small (52k train / 2.6k test, seed 42, undiacritized output).

Private / internal. This is v2, trained on the balanced, leakage-reduced data. v1 (trained on the earlier augmentation-expanded set, with the full cross-model comparison + bundled fine-tuning scripts) is at oddadmix/whisper-medium-arabic-dialectal.

Results (balanced test split ~2,600 clips, clean_text WER/CER)

WER CER
This model (v2) 0.3415 0.128

Per-dialect accuracy (v3 balanced test, clean_text)

WER / CER on each dialect's 200 held-out clips, easiest to hardest. Gulf/Levantine transcribe best; Maghrebi (Tunisian/Algerian/Moroccan) is hardest โ€” consistent across every model.

Dialect WER CER n
Saudi/Gulf (sa) 0.186 0.052 200
Egyptian (eg) 0.261 0.130 200
Iraqi (iq) 0.272 0.073 200
Syrian (sy) 0.302 0.107 200
Yemeni (ye) 0.328 0.123 200
Bahraini (bh) 0.337 0.125 200
Palestinian (ps) 0.338 0.140 200
Lebanese (lb) 0.343 0.126 200
Moroccan (ma) 0.361 0.105 200
Libyan (ly) 0.375 0.146 200
Sudanese (sd) 0.396 0.158 200
Algerian (dz) 0.428 0.172 200
Tunisian (tn) 0.534 0.225 200
Overall 0.342 0.128 2600

v2 comparison โ€” all models on the balanced dataset

Same dialect-balanced test split (~2,600 clips, oddadmix/lahgtna-v3-small), same clean_text scoring, seed 42.

Model Params WER CER
whisper-large-v3-v2 1.54B 0.320 0.120
whisper-large-v3-turbo-v2 809M 0.332 0.125
whisper-medium-v2 769M 0.342 0.128
whisper-small-v2 244M 0.403 0.153
nemotron-3.5-asr-v2 (streaming) 638M 0.423 0.148
qwen3-asr-1.7b-v3 1.7B 0.478 0.182
qwen3-asr-0.6b-v2 0.6B 0.551 0.215

whisper-large-v3-turbo-v2 is the best; Whisper fine-tunes furthest. nemotron is the streaming option. (v1 models were trained on the earlier augmentation-expanded set.)

Examples โ€” base vs. fine-tuned (one clip per dialect)

13 held-out test clips, one per dialect. Base is openai/whisper-medium untouched; fine-tuned (v2) is this model. Text is clean_text-normalized (undiacritized), matching the WER scoring. Press play to listen.

Dialect Audio Reference Base Fine-tuned
Egyptian (eg) ู„ุงุŒ ููŠ ูƒุงููŠู‡ ู‡ู†ุง ูƒุฏู‡ ุฌู†ุจ ุงู„ุฏุงุฑุŒ ู…ุน ุฃุญู…ุฏ ุฎุทูŠุจู‡ุงุŒ ูˆุฒู…ุงู†ู‡ุง ุฌุงูŠ. ู„ุง ููƒ ููŠู‡ ู‡ู†ุง ูƒุฏู‡ ุฌู†ุจ ุงู„ุฏุงุฑ ู…ุน ุฃุญู…ุฏ ุฎุทุจู‡ุง ูˆุฒู…ู†ู‡ุง ุฌุงูŠ ู„ุงููƒุฉ ููŠู‡ ู‡ู†ุง ูƒุฏู‡ ุฌู†ุจ ุงู„ุฏุงุฑุŒ ู…ุน ุงุญู…ุฏ ุฎุทุจู‡ุง ูˆุฒู…ุงู†ู‡ุง ุฌุงูŠ
Lebanese (lb) ู…ุง ูƒูˆู† ู…ุฃู…ู†ุฉ ุญุงู„ูŠ. ู…ุง ุฃู‚ุฏุฑ ุงุชุญูƒู…. ุงู…ู…. ููŠ ุนู†ุฏูŠ ุฎูˆูุŒ ุฅูŠู‡. ู…ุง ูƒูˆู† ู…ู‚ุงู…ู†ูŠ ุญุงู„ูŠ ู…ุง ุฃู‚ุฏุฑ ุฃุชุญูƒู… ููŠู‡ ุนู†ุฏูŠ ุฎูˆู ู…ุง ุฃูƒูˆู† ู…ุฃู…ู†ุฉ ุญุงู„ูŠุŒ ู…ุง ุฃู‚ุฏุฑ ุฃุชุญูƒู…. ุฅู…. ููŠ ุนู†ุฏูŠ ุฎูˆูุŒ ุฅูŠู‡.
Syrian (sy) ูŠุนู†ูŠ ุฅู†ุช ูƒุงู† ููŠ ุนู†ุฏูƒ ู†ุธุงู… ูุงู‚ุฏ ุงู„ุดุฑุนูŠุฉ ุงู„ุฏูˆู„ูŠุฉุŒ ุฏูˆู„ ู…ุง ูƒุงู†ุช ุชุนุชุฑู ููŠู‡. ุฅู‚ุงู…ุฉ ูˆ ุฏูˆู„ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุงูŠู‡ ุง ูŠุนู†ูŠ ุฅู†ุชูŠ ูƒุงู† ููŠ ุนู†ุฏูƒ ู†ุธุงู… ูุงู‚ุฏ ุงู„ุดุฑุนูŠุฉ ุงู„ุฏูˆู„ูŠุฉ ุงู„ุฏูˆู„ ู…ุง ูƒู†ุช ุชุนุฑู ููŠู‡ ุฅู‚ุงู…ุฉ ูˆุฏูˆู„
Palestinian (ps) ุฅ- ุฅุฒู…ูŠู„ ุฃู†ุณ ูˆุงุณุชุดู‡ุฏ ูˆุงู„ุฏู‡. ูˆู…ุน ุฐู„ูƒ ุณุชูƒูˆู† ู…ุฌู…ูˆุนุฉ ู…ู† ุงู„ุฃุดุฎุงุต ุงู„ุฐูŠู† ูŠุชุนุฑููˆู† ุนู† ู‡ุฐุง. ุณ- ุณ- ุฒู…ูŠู„ ุฃู†ุณุŒ ูˆุงุณุชุดู‡ุฏ ูˆุงู„ุฏู‡.
Iraqi (iq) ุงุดุชุฑูˆุง ูƒูˆู†ุชูŠู†ุฑ ุงูˆ ู†ฺฏุฏุฑ ู†ฺฏูˆู„ ูƒุฑูุงู† ุญุฏูŠุฏุŒ ูˆุงุฎุฐูˆู‡ ุจู…ู†ุทู‚ุฉ ุจุนูŠุฏุฉ ุฌุฏุง ูˆุฏูู†ูˆู‡ ุชุญุช ุงู„ุฃุฑุถ. ูˆุจุนุฏ ู…ุง ุงู†ุชู‡ูˆุง ู…ู† ูุนู„ุงุŒ ูˆ ุงุฎุชุฑูˆุง ู…ู†ุทู‚ุฉ ุจุนูŠุฏุฉ ุฌุฏุง ูˆ ุฏูู†ูˆู‡ุง ุชุญุช ุงู„ุฃุฑุถ ุฅูŠุด ุชุฑูˆุง ูƒูˆู†ุชูŠู†ุงุฑ ุฃูˆ ู†ฺฏุฏุฑ ู†ฺฏูˆู„ ูƒุฑูุงู† ุญุฏูŠุฏ ูˆุฃุฎุฐูˆู‡ ุจู…ู†ุทู‚ุฉ ุจุนูŠุฏุฉ ุฌุฏุง ูˆุฏูู†ูˆู‡ ุชุญุช ุงู„ุฃุฑุถุŒ ูˆุจุนุฏ ู…ุง ุงู†ุชู‡ูˆุง ู…ู† ูุนู„ุชู‡.
Saudi/Gulf (sa) ูˆู…ู† ู†ุณู…ุน ุฅุดุงุฑุชูƒุŒ ุชุฑุงู†ุง ู†ุงุฒู„ูŠู† ู…ุณุชู…ูŠุชูŠู†ุŒ ู…ุง ุนู†ุฏู†ุง ุดูŠ ู†ุฎุณุฑู‡. ูˆู…ู† ู†ุณู…ุน ุฅุดุงุฑุชูƒ ุชุฑู‰ ู†ู†ุงุฒู„ูŠู† ุงู„ู…ุณุชู…ูŠุชูŠู† ู…ุง ุนู†ุฏู†ุง ุดูŠุก ุฎุณุฑู‡ ูˆู…ู† ู†ุณู…ุน ุฅุดุงุฑุงุชูƒุŒ ุชุฑุงู†ุง ู†ุงุฒู„ูŠู† ู…ุณุชู…ูŠุชูŠู†ุŒ ู…ุง ุนู†ุฏู†ุง ุดูŠุก ู†ุฎุณุฑู‡.
Bahraini (bh) ูˆู„ุฏ ูˆูƒู„ ุจู†ุชุŒ ู„ุฃู†ู‡ ุฅุฐุง ูŠุจูˆู† ุฑุจ ุงู„ุนุงู„ู…ูŠู† ูŠุณุฑ ู„ู‡ู…ุŸ ูˆู„ุฏ ูˆูƒู„ ุจู†ุช ู„ุฃู†ู‡ ุฅุฐุง ูŠุจูˆู† ุฑุจ ุงู„ุนุงู„ู…ูŠู† ูŠุณุฑ ู„ู‡ุง ูˆู„ุฏ ูˆ ูƒู„ ุจู†ุช ู„ุฃู†ู‡ ุฅุฐุง ูŠุจูˆู† ุฑุจ ุงู„ุนุงู„ู…ูŠู† ูŠูŠุณุฑ ู„ู‡ุง.
Yemeni (ye) ูˆู‡ุฐุง ูƒุงู† ุงู„ ุงู„ ุงู„ ุงู„ ูŠุนู†ูŠ ุชุณุชุทูŠุน ุชุนุชุจุฑู‡ุง ูˆู‡ุฐุง ูƒุงู† ุณูŠูƒูˆู† ุชุนุชุจุฑู‡ุง ูˆู‡ุฐุง ูƒุงู† ุงู„ ุงู„ ุงู„ ุงู„ ูŠุนู†ูŠ ุชุณุชุทูŠุน ุชุนุชุจุฑู‡ุง
Libyan (ly) ู‡ู„ุจุฉ ูˆุงู„ู„ู‡ ูŠุง ุจุดุฑู‰ ู…ุง ู…ุง ูŠุญุถุฑู†ูŠุด ุญุงุฌุฉ. ููŠ ุจู„ุงุฏ ุฃูˆ ุจุฑุง ู…ู† ุงู„ุจู„ุงุฏุŸ ู‡ู„ ุจูˆุงู„ู„ู‡ ุจุดุฑุฉ ู…ุง ูŠุญุถุฑู†ูŠุด ุญุงุฌุงุชุŸ ููŠ ุงู„ุจู„ุงุฏ ุฃูˆ ุจุฑู… ุงู„ุจู„ุงุฏุŸ ุดู†ูˆุฉุŸ ู‡ู„ุจุฉ ูˆุงู„ู„ู‡ ุจุดุฑู‰ ู…ุงูŠุญุถุฑู†ูŠุด ุญุงุฌุฉ. ููŠ ุงู„ุจู„ุงุฏ ุฃูˆ ุจุฑุงู… ุงู„ุจู„ุงุฏุŸ
Tunisian (tn) ุงู„ ุงู„ุฅุญุชุฌุงุฌูŠุฉ ู…ุง ู‡ู…ุด ู… ู…ุณุชุฃู†ุณูŠู† ุจุงู„ุฃู…ุงูƒู† ุงู„ู…ู‚ุงุจู„ุฉ ุงู„ู„ูŠ ู‡ูŠ ุตุงู„ูˆู†ุงุช ุงู„ุญูƒู…. ู„ุงุญุชูŠุงุฌูŠุฉ ู…ุง ู‡ู…ุด ู…ุชู†ุณูŠู† ุจุงู„ุฃู…ุงูƒู† ุงู„ู…ู‚ุงุจู„ุฉ ูˆู‡ูŠ ุตู„ูˆู†ุงุช ุงู„ุญูƒู… ุงู„ ุงุงุง ุงู„ุงุญุชุฌุงุฌูŠุฉ ู…ุง ู‡ู…ุด ู…ุณุชุงู†ุณูŠู† ุจุงู„ุฃู…ุงูƒู† ุงู„ู…ู‚ุงุจู„ุฉุŒ ุงู„ู„ูŠ ู‡ูŠ ุตู„ูˆู†ุงุช ุงู„ุญูƒู….
Algerian (dz) ุฏูˆ ุนุงู…ูŠู†. ุจุตุญ ูˆูƒุงู† ูŠุจูŠุงุนู†ูŠ ุฃู†ุง ู†ุฏูŠ ุนุดุฑ ุณู†ูŠู† ูˆู†ุดูˆููˆ ู‡ูˆ ูŠุฎุฑุฌ ุฃู„ูŠุฒ ููŠ ุจู„ุงู„ูŠุจุฑุชูŠ. ูˆู†ุญู† ู†ุชุญุฏุซ ุนู† ู†ูุณู‡ ุฏูˆุฉ ุนุงู…ูŠู†. ุจุตุญ ู‡ูˆ ูƒุงู† ูŠุจูŠุนู†ูŠุŒ ุฃู†ุง ู†ุฏูŠ ุนุดุฑ ุณู†ูŠู† ูˆู†ุดูˆููˆ ู‡ูˆ ูŠุฎุฑุฌ ุฃู„ูŠุฒุŒ ุจู„ุง ู„ูŠ ุจุฎุชูŠ.
Moroccan (ma) ุถุงุฑุชุŒ ูˆ ุทุฑุฏุชุŒ ูˆ ูƒุงุน ุฏุงูƒ ุงู„ุดูŠ ุงู„ู„ูŠ ููŠู‡ุง ู…ู† ุงู„ุฌู†. ูˆุณูƒู†ุช ููŠู‡ุง. ูˆ ุงู„ุญู…ุฏ ู„ู„ู‡ ู…ู† ุจุนุฏ ุชุฒูˆุฌุช ุจูุฑุญุŒ ูˆ ุฃุณุงู…ุฉ ุชุฒูˆุฌ ุจูƒูˆุซุฑ. ูˆุทุงุฑุท ูˆู‚ุนุฏูƒ ุดูŠุก ููŠู‡ุง ู…ู† ุงู„ุฌูŠู† ูˆุดูƒู†ุช ููŠู‡ุง ูˆุงู„ุญู…ุฏ ู„ู„ู‡ ู…ู† ุจุนุฏ ุฒูˆุฌ ุจูุฑุงุญุฉ ูˆุณุงู…ุฉ ุฒูˆุฌ ุจูƒูˆุดุฑ ุงู„ุฏุงุฑ ูˆุงู„ุถุงุฑุทุฉ ูˆูƒุงุน ุฏุงูƒุดูŠ ุงู„ู„ูŠ ููŠู‡ุง ู…ู† ุงู„ุฌู†. ูˆุณูƒู†ุช ููŠู‡ุงุŒ ูˆุงู„ุญู…ุฏ ู„ู„ู‡ ู…ู† ุจุนุฏ ุชุฒูˆุฌุช ุจูุฑุงุญุŒ ูˆุฃุณุงู…ุฉ ุชุฒูˆุฌุช ุจูƒูˆุชุฑ.
Sudanese (sd) ุขุงุง ู‡ู…ุงุฑุงุช ุจูŠู†ุฒู„ู‡ุง ููŠ ุงู„ููŠุณุŒ ุฃูˆ ุจุนุฏ ุงู„ ู‡ู†ุง ุฃู‚ูˆู… ุฃุญุถุฑ ุงู„ุฎุทุจุฉ ุจุชุงุนุฉ ุทุงุฑู‚ ุงู„ู‡ุงุฏูŠ. ูŠุนู†ูŠ ุงู‡ ู‡ู…ุง ุฑุงุฏูŠูˆ ู†ุฒูŠู„ู‡ ููŠ ุงู„ููŠุณ ุงูˆ ุจุนุฏ ุงู„ู‡ู†ุง ูŠุฌูˆู… ุงุญุถุฑ ุงู„ุฎุทุจุฉ ุจุชุงุนุฉ ุทุงุฑู‚ ุงู„ู‡ุฏูŠ ุขุข ู‡ูˆ ุฑุงุฏูŠ ูŠู†ุฒูŠู„ู‡ ููŠ ุงู„ููŠุณุŒ ุฃูˆ ุจุนุฏ ุงู„ ู‡ู†ุง ูŠู‚ูˆู… ูŠุญุถุฑ ุงู„ุฎุทุจุฉ ุจุชุงุนุช ุทุงุฑู‚ ุงู„ู‡ุงุฏูŠ. ูŠุนู†ูŠ

Full fine-tuning code, dependencies, and lessons are in the v1 repo (train.py, normalize.py, FINETUNE.md). This v2 uses the same recipe on the balanced dataset.

Downloads last month
6
Safetensors
Model size
0.8B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for oddadmix/whisper-medium-arabic-dialectal-v2

Finetuned
(900)
this model

Collection including oddadmix/whisper-medium-arabic-dialectal-v2