|
--- |
|
tags: |
|
- mms |
|
language: |
|
- ab |
|
- af |
|
- ak |
|
- am |
|
- ar |
|
- as |
|
- av |
|
- ay |
|
- az |
|
- ba |
|
- bm |
|
- be |
|
- bn |
|
- bi |
|
- bo |
|
- sh |
|
- br |
|
- bg |
|
- ca |
|
- cs |
|
- ce |
|
- cv |
|
- ku |
|
- cy |
|
- da |
|
- de |
|
- dv |
|
- dz |
|
- el |
|
- en |
|
- eo |
|
- et |
|
- eu |
|
- ee |
|
- fo |
|
- fa |
|
- fj |
|
- fi |
|
- fr |
|
- fy |
|
- ff |
|
- ga |
|
- gl |
|
- gn |
|
- gu |
|
- zh |
|
- ht |
|
- ha |
|
- he |
|
- hi |
|
- sh |
|
- hu |
|
- hy |
|
- ig |
|
- ia |
|
- ms |
|
- is |
|
- it |
|
- jv |
|
- ja |
|
- kn |
|
- ka |
|
- kk |
|
- kr |
|
- km |
|
- ki |
|
- rw |
|
- ky |
|
- ko |
|
- kv |
|
- lo |
|
- la |
|
- lv |
|
- ln |
|
- lt |
|
- lb |
|
- lg |
|
- mh |
|
- ml |
|
- mr |
|
- ms |
|
- mk |
|
- mg |
|
- mt |
|
- mn |
|
- mi |
|
- my |
|
- zh |
|
- nl |
|
- 'no' |
|
- 'no' |
|
- ne |
|
- ny |
|
- oc |
|
- om |
|
- or |
|
- os |
|
- pa |
|
- pl |
|
- pt |
|
- ms |
|
- ps |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- qu |
|
- ro |
|
- rn |
|
- ru |
|
- sg |
|
- sk |
|
- sl |
|
- sm |
|
- sn |
|
- sd |
|
- so |
|
- es |
|
- sq |
|
- su |
|
- sv |
|
- sw |
|
- ta |
|
- tt |
|
- te |
|
- tg |
|
- tl |
|
- th |
|
- ti |
|
- ts |
|
- tr |
|
- uk |
|
- ms |
|
- vi |
|
- wo |
|
- xh |
|
- ms |
|
- yo |
|
- ms |
|
- zu |
|
- za |
|
license: cc-by-nc-4.0 |
|
datasets: |
|
- google/fleurs |
|
metrics: |
|
- wer |
|
--- |
|
|
|
# Massively Multilingual Speech (MMS) - Finetuned ASR - ALL |
|
|
|
This checkpoint is a model fine-tuned for multi-lingual ASR and part of Facebook's [Massive Multilingual Speech project](https://research.facebook.com/publications/scaling-speech-technology-to-1000-languages/). |
|
This checkpoint is based on the [Wav2Vec2 architecture](https://huggingface.co/docs/transformers/model_doc/wav2vec2) and makes use of adapter models to transcribe 1000+ languages. |
|
The checkpoint consists of **1 billion parameters** and has been fine-tuned from [facebook/mms-1b](https://huggingface.co/facebook/mms-1b) on 1162 languages. |
|
|
|
## Table Of Content |
|
|
|
- [Example](#example) |
|
- [Supported Languages](#supported-languages) |
|
- [Model details](#model-details) |
|
- [Additional links](#additional-links) |
|
|
|
## Example |
|
|
|
This MMS checkpoint can be used with [Transformers](https://github.com/huggingface/transformers) to transcribe audio of 1107 different |
|
languages. Let's look at a simple example. |
|
|
|
First, we install transformers and some other libraries |
|
``` |
|
pip install torch accelerate torchaudio datasets |
|
pip install --upgrade transformers |
|
```` |
|
|
|
**Note**: In order to use MMS you need to have at least `transformers >= 4.30` installed. If the `4.30` version |
|
is not yet available [on PyPI](https://pypi.org/project/transformers/) make sure to install `transformers` from |
|
source: |
|
``` |
|
pip install git+https://github.com/huggingface/transformers.git |
|
``` |
|
|
|
Next, we load a couple of audio samples via `datasets`. Make sure that the audio data is sampled to 16000 kHz. |
|
|
|
```py |
|
from datasets import load_dataset, Audio |
|
|
|
# English |
|
stream_data = load_dataset("mozilla-foundation/common_voice_13_0", "en", split="test", streaming=True) |
|
stream_data = stream_data.cast_column("audio", Audio(sampling_rate=16000)) |
|
en_sample = next(iter(stream_data))["audio"]["array"] |
|
|
|
# French |
|
stream_data = load_dataset("mozilla-foundation/common_voice_13_0", "fr", split="test", streaming=True) |
|
stream_data = stream_data.cast_column("audio", Audio(sampling_rate=16000)) |
|
fr_sample = next(iter(stream_data))["audio"]["array"] |
|
``` |
|
|
|
Next, we load the model and processor |
|
|
|
```py |
|
from transformers import Wav2Vec2ForCTC, AutoProcessor |
|
import torch |
|
|
|
model_id = "facebook/mms-1b-all" |
|
|
|
processor = AutoProcessor.from_pretrained(model_id) |
|
model = Wav2Vec2ForCTC.from_pretrained(model_id) |
|
``` |
|
|
|
Now we process the audio data, pass the processed audio data to the model and transcribe the model output, just like we usually do for Wav2Vec2 models such as [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) |
|
|
|
```py |
|
inputs = processor(en_sample, sampling_rate=16_000, return_tensors="pt") |
|
|
|
with torch.no_grad(): |
|
outputs = model(**inputs).logits |
|
|
|
ids = torch.argmax(outputs, dim=-1)[0] |
|
transcription = processor.decode(ids) |
|
# 'joe keton disapproved of films and buster also had reservations about the media' |
|
``` |
|
|
|
We can now keep the same model in memory and simply switch out the language adapters by calling the convenient [`load_adapter()`]() function for the model and [`set_target_lang()`]() for the tokenizer. We pass the target language as an input - "fra" for French. |
|
|
|
```py |
|
processor.tokenizer.set_target_lang("fra") |
|
model.load_adapter("fra") |
|
|
|
inputs = processor(fr_sample, sampling_rate=16_000, return_tensors="pt") |
|
|
|
with torch.no_grad(): |
|
outputs = model(**inputs).logits |
|
|
|
ids = torch.argmax(outputs, dim=-1)[0] |
|
transcription = processor.decode(ids) |
|
# "ce dernier est volé tout au long de l'histoire romaine" |
|
``` |
|
|
|
In the same way the language can be switched out for all other supported languages. Please have a look at: |
|
```py |
|
processor.tokenizer.vocab.keys() |
|
``` |
|
|
|
For more details, please have a look at [the official docs](https://huggingface.co/docs/transformers/main/en/model_doc/mms). |
|
|
|
## Supported Languages |
|
|
|
This model supports 1162 languages. Unclick the following to toogle all supported languages of this checkpoint in [ISO 639-3 code](https://en.wikipedia.org/wiki/ISO_639-3). |
|
You can find more details about the languages and their ISO 649-3 codes in the [MMS Language Coverage Overview](https://dl.fbaipublicfiles.com/mms/misc/language_coverage_mms.html). |
|
<details> |
|
<summary>Click to toggle</summary> |
|
|
|
- abi |
|
- abk |
|
- abp |
|
- aca |
|
- acd |
|
- ace |
|
- acf |
|
- ach |
|
- acn |
|
- acr |
|
- acu |
|
- ade |
|
- adh |
|
- adj |
|
- adx |
|
- aeu |
|
- afr |
|
- agd |
|
- agg |
|
- agn |
|
- agr |
|
- agu |
|
- agx |
|
- aha |
|
- ahk |
|
- aia |
|
- aka |
|
- akb |
|
- ake |
|
- akp |
|
- alj |
|
- alp |
|
- alt |
|
- alz |
|
- ame |
|
- amf |
|
- amh |
|
- ami |
|
- amk |
|
- ann |
|
- any |
|
- aoz |
|
- apb |
|
- apr |
|
- ara |
|
- arl |
|
- asa |
|
- asg |
|
- asm |
|
- ast |
|
- ata |
|
- atb |
|
- atg |
|
- ati |
|
- atq |
|
- ava |
|
- avn |
|
- avu |
|
- awa |
|
- awb |
|
- ayo |
|
- ayr |
|
- ayz |
|
- azb |
|
- azg |
|
- azj-script_cyrillic |
|
- azj-script_latin |
|
- azz |
|
- bak |
|
- bam |
|
- ban |
|
- bao |
|
- bas |
|
- bav |
|
- bba |
|
- bbb |
|
- bbc |
|
- bbo |
|
- bcc-script_arabic |
|
- bcc-script_latin |
|
- bcl |
|
- bcw |
|
- bdg |
|
- bdh |
|
- bdq |
|
- bdu |
|
- bdv |
|
- beh |
|
- bel |
|
- bem |
|
- ben |
|
- bep |
|
- bex |
|
- bfa |
|
- bfo |
|
- bfy |
|
- bfz |
|
- bgc |
|
- bgq |
|
- bgr |
|
- bgt |
|
- bgw |
|
- bha |
|
- bht |
|
- bhz |
|
- bib |
|
- bim |
|
- bis |
|
- biv |
|
- bjr |
|
- bjv |
|
- bjw |
|
- bjz |
|
- bkd |
|
- bkv |
|
- blh |
|
- blt |
|
- blx |
|
- blz |
|
- bmq |
|
- bmr |
|
- bmu |
|
- bmv |
|
- bng |
|
- bno |
|
- bnp |
|
- boa |
|
- bod |
|
- boj |
|
- bom |
|
- bor |
|
- bos |
|
- bov |
|
- box |
|
- bpr |
|
- bps |
|
- bqc |
|
- bqi |
|
- bqj |
|
- bqp |
|
- bre |
|
- bru |
|
- bsc |
|
- bsq |
|
- bss |
|
- btd |
|
- bts |
|
- btt |
|
- btx |
|
- bud |
|
- bul |
|
- bus |
|
- bvc |
|
- bvz |
|
- bwq |
|
- bwu |
|
- byr |
|
- bzh |
|
- bzi |
|
- bzj |
|
- caa |
|
- cab |
|
- cac-dialect_sanmateoixtatan |
|
- cac-dialect_sansebastiancoatan |
|
- cak-dialect_central |
|
- cak-dialect_santamariadejesus |
|
- cak-dialect_santodomingoxenacoj |
|
- cak-dialect_southcentral |
|
- cak-dialect_western |
|
- cak-dialect_yepocapa |
|
- cap |
|
- car |
|
- cas |
|
- cat |
|
- cax |
|
- cbc |
|
- cbi |
|
- cbr |
|
- cbs |
|
- cbt |
|
- cbu |
|
- cbv |
|
- cce |
|
- cco |
|
- cdj |
|
- ceb |
|
- ceg |
|
- cek |
|
- ces |
|
- cfm |
|
- cgc |
|
- che |
|
- chf |
|
- chv |
|
- chz |
|
- cjo |
|
- cjp |
|
- cjs |
|
- ckb |
|
- cko |
|
- ckt |
|
- cla |
|
- cle |
|
- cly |
|
- cme |
|
- cmn-script_simplified |
|
- cmo-script_khmer |
|
- cmo-script_latin |
|
- cmr |
|
- cnh |
|
- cni |
|
- cnl |
|
- cnt |
|
- coe |
|
- cof |
|
- cok |
|
- con |
|
- cot |
|
- cou |
|
- cpa |
|
- cpb |
|
- cpu |
|
- crh |
|
- crk-script_latin |
|
- crk-script_syllabics |
|
- crn |
|
- crq |
|
- crs |
|
- crt |
|
- csk |
|
- cso |
|
- ctd |
|
- ctg |
|
- cto |
|
- ctu |
|
- cuc |
|
- cui |
|
- cuk |
|
- cul |
|
- cwa |
|
- cwe |
|
- cwt |
|
- cya |
|
- cym |
|
- daa |
|
- dah |
|
- dan |
|
- dar |
|
- dbj |
|
- dbq |
|
- ddn |
|
- ded |
|
- des |
|
- deu |
|
- dga |
|
- dgi |
|
- dgk |
|
- dgo |
|
- dgr |
|
- dhi |
|
- did |
|
- dig |
|
- dik |
|
- dip |
|
- div |
|
- djk |
|
- dnj-dialect_blowowest |
|
- dnj-dialect_gweetaawueast |
|
- dnt |
|
- dnw |
|
- dop |
|
- dos |
|
- dsh |
|
- dso |
|
- dtp |
|
- dts |
|
- dug |
|
- dwr |
|
- dyi |
|
- dyo |
|
- dyu |
|
- dzo |
|
- eip |
|
- eka |
|
- ell |
|
- emp |
|
- enb |
|
- eng |
|
- enx |
|
- epo |
|
- ese |
|
- ess |
|
- est |
|
- eus |
|
- evn |
|
- ewe |
|
- eza |
|
- fal |
|
- fao |
|
- far |
|
- fas |
|
- fij |
|
- fin |
|
- flr |
|
- fmu |
|
- fon |
|
- fra |
|
- frd |
|
- fry |
|
- ful |
|
- gag-script_cyrillic |
|
- gag-script_latin |
|
- gai |
|
- gam |
|
- gau |
|
- gbi |
|
- gbk |
|
- gbm |
|
- gbo |
|
- gde |
|
- geb |
|
- gej |
|
- gil |
|
- gjn |
|
- gkn |
|
- gld |
|
- gle |
|
- glg |
|
- glk |
|
- gmv |
|
- gna |
|
- gnd |
|
- gng |
|
- gof-script_latin |
|
- gog |
|
- gor |
|
- gqr |
|
- grc |
|
- gri |
|
- grn |
|
- grt |
|
- gso |
|
- gub |
|
- guc |
|
- gud |
|
- guh |
|
- guj |
|
- guk |
|
- gum |
|
- guo |
|
- guq |
|
- guu |
|
- gux |
|
- gvc |
|
- gvl |
|
- gwi |
|
- gwr |
|
- gym |
|
- gyr |
|
- had |
|
- hag |
|
- hak |
|
- hap |
|
- hat |
|
- hau |
|
- hay |
|
- heb |
|
- heh |
|
- hif |
|
- hig |
|
- hil |
|
- hin |
|
- hlb |
|
- hlt |
|
- hne |
|
- hnn |
|
- hns |
|
- hoc |
|
- hoy |
|
- hrv |
|
- hsb |
|
- hto |
|
- hub |
|
- hui |
|
- hun |
|
- hus-dialect_centralveracruz |
|
- hus-dialect_westernpotosino |
|
- huu |
|
- huv |
|
- hvn |
|
- hwc |
|
- hye |
|
- hyw |
|
- iba |
|
- ibo |
|
- icr |
|
- idd |
|
- ifa |
|
- ifb |
|
- ife |
|
- ifk |
|
- ifu |
|
- ify |
|
- ign |
|
- ikk |
|
- ilb |
|
- ilo |
|
- imo |
|
- ina |
|
- inb |
|
- ind |
|
- iou |
|
- ipi |
|
- iqw |
|
- iri |
|
- irk |
|
- isl |
|
- ita |
|
- itl |
|
- itv |
|
- ixl-dialect_sangasparchajul |
|
- ixl-dialect_sanjuancotzal |
|
- ixl-dialect_santamarianebaj |
|
- izr |
|
- izz |
|
- jac |
|
- jam |
|
- jav |
|
- jbu |
|
- jen |
|
- jic |
|
- jiv |
|
- jmc |
|
- jmd |
|
- jpn |
|
- jun |
|
- juy |
|
- jvn |
|
- kaa |
|
- kab |
|
- kac |
|
- kak |
|
- kam |
|
- kan |
|
- kao |
|
- kaq |
|
- kat |
|
- kay |
|
- kaz |
|
- kbo |
|
- kbp |
|
- kbq |
|
- kbr |
|
- kby |
|
- kca |
|
- kcg |
|
- kdc |
|
- kde |
|
- kdh |
|
- kdi |
|
- kdj |
|
- kdl |
|
- kdn |
|
- kdt |
|
- kea |
|
- kek |
|
- ken |
|
- keo |
|
- ker |
|
- key |
|
- kez |
|
- kfb |
|
- kff-script_telugu |
|
- kfw |
|
- kfx |
|
- khg |
|
- khm |
|
- khq |
|
- kia |
|
- kij |
|
- kik |
|
- kin |
|
- kir |
|
- kjb |
|
- kje |
|
- kjg |
|
- kjh |
|
- kki |
|
- kkj |
|
- kle |
|
- klu |
|
- klv |
|
- klw |
|
- kma |
|
- kmd |
|
- kml |
|
- kmr-script_arabic |
|
- kmr-script_cyrillic |
|
- kmr-script_latin |
|
- kmu |
|
- knb |
|
- kne |
|
- knf |
|
- knj |
|
- knk |
|
- kno |
|
- kog |
|
- kor |
|
- kpq |
|
- kps |
|
- kpv |
|
- kpy |
|
- kpz |
|
- kqe |
|
- kqp |
|
- kqr |
|
- kqy |
|
- krc |
|
- kri |
|
- krj |
|
- krl |
|
- krr |
|
- krs |
|
- kru |
|
- ksb |
|
- ksr |
|
- kss |
|
- ktb |
|
- ktj |
|
- kub |
|
- kue |
|
- kum |
|
- kus |
|
- kvn |
|
- kvw |
|
- kwd |
|
- kwf |
|
- kwi |
|
- kxc |
|
- kxf |
|
- kxm |
|
- kxv |
|
- kyb |
|
- kyc |
|
- kyf |
|
- kyg |
|
- kyo |
|
- kyq |
|
- kyu |
|
- kyz |
|
- kzf |
|
- lac |
|
- laj |
|
- lam |
|
- lao |
|
- las |
|
- lat |
|
- lav |
|
- law |
|
- lbj |
|
- lbw |
|
- lcp |
|
- lee |
|
- lef |
|
- lem |
|
- lew |
|
- lex |
|
- lgg |
|
- lgl |
|
- lhu |
|
- lia |
|
- lid |
|
- lif |
|
- lin |
|
- lip |
|
- lis |
|
- lit |
|
- lje |
|
- ljp |
|
- llg |
|
- lln |
|
- lme |
|
- lnd |
|
- lns |
|
- lob |
|
- lok |
|
- lom |
|
- lon |
|
- loq |
|
- lsi |
|
- lsm |
|
- ltz |
|
- luc |
|
- lug |
|
- luo |
|
- lwo |
|
- lww |
|
- lzz |
|
- maa-dialect_sanantonio |
|
- maa-dialect_sanjeronimo |
|
- mad |
|
- mag |
|
- mah |
|
- mai |
|
- maj |
|
- mak |
|
- mal |
|
- mam-dialect_central |
|
- mam-dialect_northern |
|
- mam-dialect_southern |
|
- mam-dialect_western |
|
- maq |
|
- mar |
|
- maw |
|
- maz |
|
- mbb |
|
- mbc |
|
- mbh |
|
- mbj |
|
- mbt |
|
- mbu |
|
- mbz |
|
- mca |
|
- mcb |
|
- mcd |
|
- mco |
|
- mcp |
|
- mcq |
|
- mcu |
|
- mda |
|
- mdf |
|
- mdv |
|
- mdy |
|
- med |
|
- mee |
|
- mej |
|
- men |
|
- meq |
|
- met |
|
- mev |
|
- mfe |
|
- mfh |
|
- mfi |
|
- mfk |
|
- mfq |
|
- mfy |
|
- mfz |
|
- mgd |
|
- mge |
|
- mgh |
|
- mgo |
|
- mhi |
|
- mhr |
|
- mhu |
|
- mhx |
|
- mhy |
|
- mib |
|
- mie |
|
- mif |
|
- mih |
|
- mil |
|
- mim |
|
- min |
|
- mio |
|
- mip |
|
- miq |
|
- mit |
|
- miy |
|
- miz |
|
- mjl |
|
- mjv |
|
- mkd |
|
- mkl |
|
- mkn |
|
- mlg |
|
- mlt |
|
- mmg |
|
- mnb |
|
- mnf |
|
- mnk |
|
- mnw |
|
- mnx |
|
- moa |
|
- mog |
|
- mon |
|
- mop |
|
- mor |
|
- mos |
|
- mox |
|
- moz |
|
- mpg |
|
- mpm |
|
- mpp |
|
- mpx |
|
- mqb |
|
- mqf |
|
- mqj |
|
- mqn |
|
- mri |
|
- mrw |
|
- msy |
|
- mtd |
|
- mtj |
|
- mto |
|
- muh |
|
- mup |
|
- mur |
|
- muv |
|
- muy |
|
- mvp |
|
- mwq |
|
- mwv |
|
- mxb |
|
- mxq |
|
- mxt |
|
- mxv |
|
- mya |
|
- myb |
|
- myk |
|
- myl |
|
- myv |
|
- myx |
|
- myy |
|
- mza |
|
- mzi |
|
- mzj |
|
- mzk |
|
- mzm |
|
- mzw |
|
- nab |
|
- nag |
|
- nan |
|
- nas |
|
- naw |
|
- nca |
|
- nch |
|
- ncj |
|
- ncl |
|
- ncu |
|
- ndj |
|
- ndp |
|
- ndv |
|
- ndy |
|
- ndz |
|
- neb |
|
- new |
|
- nfa |
|
- nfr |
|
- nga |
|
- ngl |
|
- ngp |
|
- ngu |
|
- nhe |
|
- nhi |
|
- nhu |
|
- nhw |
|
- nhx |
|
- nhy |
|
- nia |
|
- nij |
|
- nim |
|
- nin |
|
- nko |
|
- nlc |
|
- nld |
|
- nlg |
|
- nlk |
|
- nmz |
|
- nnb |
|
- nno |
|
- nnq |
|
- nnw |
|
- noa |
|
- nob |
|
- nod |
|
- nog |
|
- not |
|
- npi |
|
- npl |
|
- npy |
|
- nso |
|
- nst |
|
- nsu |
|
- ntm |
|
- ntr |
|
- nuj |
|
- nus |
|
- nuz |
|
- nwb |
|
- nxq |
|
- nya |
|
- nyf |
|
- nyn |
|
- nyo |
|
- nyy |
|
- nzi |
|
- obo |
|
- oci |
|
- ojb-script_latin |
|
- ojb-script_syllabics |
|
- oku |
|
- old |
|
- omw |
|
- onb |
|
- ood |
|
- orm |
|
- ory |
|
- oss |
|
- ote |
|
- otq |
|
- ozm |
|
- pab |
|
- pad |
|
- pag |
|
- pam |
|
- pan |
|
- pao |
|
- pap |
|
- pau |
|
- pbb |
|
- pbc |
|
- pbi |
|
- pce |
|
- pcm |
|
- peg |
|
- pez |
|
- pib |
|
- pil |
|
- pir |
|
- pis |
|
- pjt |
|
- pkb |
|
- pls |
|
- plw |
|
- pmf |
|
- pny |
|
- poh-dialect_eastern |
|
- poh-dialect_western |
|
- poi |
|
- pol |
|
- por |
|
- poy |
|
- ppk |
|
- pps |
|
- prf |
|
- prk |
|
- prt |
|
- pse |
|
- pss |
|
- ptu |
|
- pui |
|
- pus |
|
- pwg |
|
- pww |
|
- pxm |
|
- qub |
|
- quc-dialect_central |
|
- quc-dialect_east |
|
- quc-dialect_north |
|
- quf |
|
- quh |
|
- qul |
|
- quw |
|
- quy |
|
- quz |
|
- qvc |
|
- qve |
|
- qvh |
|
- qvm |
|
- qvn |
|
- qvo |
|
- qvs |
|
- qvw |
|
- qvz |
|
- qwh |
|
- qxh |
|
- qxl |
|
- qxn |
|
- qxo |
|
- qxr |
|
- rah |
|
- rai |
|
- rap |
|
- rav |
|
- raw |
|
- rej |
|
- rel |
|
- rgu |
|
- rhg |
|
- rif-script_arabic |
|
- rif-script_latin |
|
- ril |
|
- rim |
|
- rjs |
|
- rkt |
|
- rmc-script_cyrillic |
|
- rmc-script_latin |
|
- rmo |
|
- rmy-script_cyrillic |
|
- rmy-script_latin |
|
- rng |
|
- rnl |
|
- roh-dialect_sursilv |
|
- roh-dialect_vallader |
|
- rol |
|
- ron |
|
- rop |
|
- rro |
|
- rub |
|
- ruf |
|
- rug |
|
- run |
|
- rus |
|
- sab |
|
- sag |
|
- sah |
|
- saj |
|
- saq |
|
- sas |
|
- sat |
|
- sba |
|
- sbd |
|
- sbl |
|
- sbp |
|
- sch |
|
- sck |
|
- sda |
|
- sea |
|
- seh |
|
- ses |
|
- sey |
|
- sgb |
|
- sgj |
|
- sgw |
|
- shi |
|
- shk |
|
- shn |
|
- sho |
|
- shp |
|
- sid |
|
- sig |
|
- sil |
|
- sja |
|
- sjm |
|
- sld |
|
- slk |
|
- slu |
|
- slv |
|
- sml |
|
- smo |
|
- sna |
|
- snd |
|
- sne |
|
- snn |
|
- snp |
|
- snw |
|
- som |
|
- soy |
|
- spa |
|
- spp |
|
- spy |
|
- sqi |
|
- sri |
|
- srm |
|
- srn |
|
- srp-script_cyrillic |
|
- srp-script_latin |
|
- srx |
|
- stn |
|
- stp |
|
- suc |
|
- suk |
|
- sun |
|
- sur |
|
- sus |
|
- suv |
|
- suz |
|
- swe |
|
- swh |
|
- sxb |
|
- sxn |
|
- sya |
|
- syl |
|
- sza |
|
- tac |
|
- taj |
|
- tam |
|
- tao |
|
- tap |
|
- taq |
|
- tat |
|
- tav |
|
- tbc |
|
- tbg |
|
- tbk |
|
- tbl |
|
- tby |
|
- tbz |
|
- tca |
|
- tcc |
|
- tcs |
|
- tcz |
|
- tdj |
|
- ted |
|
- tee |
|
- tel |
|
- tem |
|
- teo |
|
- ter |
|
- tes |
|
- tew |
|
- tex |
|
- tfr |
|
- tgj |
|
- tgk |
|
- tgl |
|
- tgo |
|
- tgp |
|
- tha |
|
- thk |
|
- thl |
|
- tih |
|
- tik |
|
- tir |
|
- tkr |
|
- tlb |
|
- tlj |
|
- tly |
|
- tmc |
|
- tmf |
|
- tna |
|
- tng |
|
- tnk |
|
- tnn |
|
- tnp |
|
- tnr |
|
- tnt |
|
- tob |
|
- toc |
|
- toh |
|
- tom |
|
- tos |
|
- tpi |
|
- tpm |
|
- tpp |
|
- tpt |
|
- trc |
|
- tri |
|
- trn |
|
- trs |
|
- tso |
|
- tsz |
|
- ttc |
|
- tte |
|
- ttq-script_tifinagh |
|
- tue |
|
- tuf |
|
- tuk-script_arabic |
|
- tuk-script_latin |
|
- tuo |
|
- tur |
|
- tvw |
|
- twb |
|
- twe |
|
- twu |
|
- txa |
|
- txq |
|
- txu |
|
- tye |
|
- tzh-dialect_bachajon |
|
- tzh-dialect_tenejapa |
|
- tzj-dialect_eastern |
|
- tzj-dialect_western |
|
- tzo-dialect_chamula |
|
- tzo-dialect_chenalho |
|
- ubl |
|
- ubu |
|
- udm |
|
- udu |
|
- uig-script_arabic |
|
- uig-script_cyrillic |
|
- ukr |
|
- umb |
|
- unr |
|
- upv |
|
- ura |
|
- urb |
|
- urd-script_arabic |
|
- urd-script_devanagari |
|
- urd-script_latin |
|
- urk |
|
- urt |
|
- ury |
|
- usp |
|
- uzb-script_cyrillic |
|
- uzb-script_latin |
|
- vag |
|
- vid |
|
- vie |
|
- vif |
|
- vmw |
|
- vmy |
|
- vot |
|
- vun |
|
- vut |
|
- wal-script_ethiopic |
|
- wal-script_latin |
|
- wap |
|
- war |
|
- waw |
|
- way |
|
- wba |
|
- wlo |
|
- wlx |
|
- wmw |
|
- wob |
|
- wol |
|
- wsg |
|
- wwa |
|
- xal |
|
- xdy |
|
- xed |
|
- xer |
|
- xho |
|
- xmm |
|
- xnj |
|
- xnr |
|
- xog |
|
- xon |
|
- xrb |
|
- xsb |
|
- xsm |
|
- xsr |
|
- xsu |
|
- xta |
|
- xtd |
|
- xte |
|
- xtm |
|
- xtn |
|
- xua |
|
- xuo |
|
- yaa |
|
- yad |
|
- yal |
|
- yam |
|
- yao |
|
- yas |
|
- yat |
|
- yaz |
|
- yba |
|
- ybb |
|
- ycl |
|
- ycn |
|
- yea |
|
- yka |
|
- yli |
|
- yor |
|
- yre |
|
- yua |
|
- yue-script_traditional |
|
- yuz |
|
- yva |
|
- zaa |
|
- zab |
|
- zac |
|
- zad |
|
- zae |
|
- zai |
|
- zam |
|
- zao |
|
- zaq |
|
- zar |
|
- zas |
|
- zav |
|
- zaw |
|
- zca |
|
- zga |
|
- zim |
|
- ziw |
|
- zlm |
|
- zmz |
|
- zne |
|
- zos |
|
- zpc |
|
- zpg |
|
- zpi |
|
- zpl |
|
- zpm |
|
- zpo |
|
- zpt |
|
- zpu |
|
- zpz |
|
- ztq |
|
- zty |
|
- zul |
|
- zyb |
|
- zyp |
|
- zza |
|
|
|
</details> |
|
|
|
## Model details |
|
|
|
- **Developed by:** Vineel Pratap et al. |
|
- **Model type:** Multi-Lingual Automatic Speech Recognition model |
|
- **Language(s):** 1000+ languages, see [supported languages](#supported-languages) |
|
- **License:** CC-BY-NC 4.0 license |
|
- **Num parameters**: 1 billion |
|
- **Audio sampling rate**: 16,000 kHz |
|
- **Cite as:** |
|
|
|
@article{pratap2023mms, |
|
title={Scaling Speech Technology to 1,000+ Languages}, |
|
author={Vineel Pratap and Andros Tjandra and Bowen Shi and Paden Tomasello and Arun Babu and Sayani Kundu and Ali Elkahky and Zhaoheng Ni and Apoorv Vyas and Maryam Fazel-Zarandi and Alexei Baevski and Yossi Adi and Xiaohui Zhang and Wei-Ning Hsu and Alexis Conneau and Michael Auli}, |
|
journal={arXiv}, |
|
year={2023} |
|
} |
|
|
|
## Additional Links |
|
|
|
- [Blog post](https://ai.facebook.com/blog/multilingual-model-speech-recognition/) |
|
- [Transformers documentation](https://huggingface.co/docs/transformers/main/en/model_doc/mms). |
|
- [Paper](https://arxiv.org/abs/2305.13516) |
|
- [GitHub Repository](https://github.com/facebookresearch/fairseq/tree/main/examples/mms#asr) |
|
- [Other **MMS** checkpoints](https://huggingface.co/models?other=mms) |
|
- MMS base checkpoints: |
|
- [facebook/mms-1b](https://huggingface.co/facebook/mms-1b) |
|
- [facebook/mms-300m](https://huggingface.co/facebook/mms-300m) |
|
- [Official Space](https://huggingface.co/spaces/facebook/MMS) |
|
|
