Whisper large-v3-turbo (whisper), released 2024-10
Task: Speech to text
Parameters: 0.809B
Mixture-of-experts: no
Precision: int8 (faster-whisper) / fp16 (whisper.cpp)
Recommended memory:
gb: 1.5
quant: int8
Runs on CPU: yes
Device classes: mac, nvidia, amd, laptop, iphone, android
Tools: whisper.cpp, faster-whisper, MacWhisper, WhisperKit
Model license: MIT (commercial use: yes)
Notes: Pruned large-v3 (decoder layers cut from 32 to 4, ~809M params) that runs roughly 5x faster at near-large-v3 accuracy. Via faster-whisper int8 it peaks at ~1.5GB VRAM (1,545MB measured). Light enough for phones (CoreML) and CPU. License MIT. Sources: HF model card, faster-whisper benchmark, whisper.cpp README.