Hugging Face's logo

Spaces:
Brand24
/
mms_benchmark
Runtime error

App Files Community
Szymon Woźniak commited on
Commit
8e70d7d
•
1 Parent(s): e883a51

fix latex formatting in names of datasets

Browse files
Files changed (1) hide show
  1. MMS_Benchmark.py +5 -5
MMS_Benchmark.py CHANGED
@@ -19,15 +19,15 @@ TITLE = "MMS Dataset and Benchmark"
19
  MODELS_TABLE = """\
20
  | Model | Inf. time [s] | #params | #langs | base | data | reference |
21
  |----------------|---------------|---------|--------|--------|-------------------------------------------|---------------------------|
22
- | mT5 | 1.69 | 277M | 101 | T5 | $CC^b$ | [Xue et al. 2021](https://doi.org/10.18653/v1/2021.naacl-main.41) |
23
- | LASER | 1.64 | 52M | 93 | BiLSTM | $OPUS^c$ | [Artetxe and Schwenk 2019](https://doi.org/10.1162/tacl_a_00288) |
24
  | mBERT | 1.49 | 177M | 104 | BERT | Wiki | [Devlin et al. 2019](https://doi.org/10.18653/v1/N19-1423) |
25
- | MPNet** | 1.38 | 278M | 53 | XLM-R | $OPUS^c$, $MUSE^d$, $Wikititles^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
26
- | XLM-R-dist** | 1.37 | 278M | 53 | XLM-R | $OPUS^c$, $MUSE^d$, $Wikititles^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
27
  | XLM-R | 1.37 | 278M | 100 | XLM-R | CC | [Conneau et al. 2020](https://doi.org/10.18653/v1/2020.acl-main.747) |
28
  | LaBSE | 1.36 | 470M | 109 | BERT | CC, Wiki + mined bitexts | [Feng et al. 2020](https://arxiv.org/abs/2007.01852) |
29
  | DistilmBERT | 0.79 | 134M | 104 | BERT | Wiki | [Sanh et al. 2020](https://arxiv.org/abs/1910.01108) |
30
- | mUSE-dist** | 0.79 | 134M | 53 | DistilmBERT | $OPUS^c$, $MUSE^d$, $Wikititles^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
31
  | mUSE-transformer* | 0.65 | 85M | 16 | transformer | mined QA + bitexts, SNLI | [Yang et al. 2020](https://doi.org/10.18653/v1/2020.acl-demos.12) |
32
  | mUSE-cnn* | 0.12 | 68M | 16 | CNN | mined QA + bitexts, SNLI | [Yang et al. 2020](https://doi.org/10.18653/v1/2020.acl-demos.12) |"""
33
 
 
19
  MODELS_TABLE = """\
20
  | Model | Inf. time [s] | #params | #langs | base | data | reference |
21
  |----------------|---------------|---------|--------|--------|-------------------------------------------|---------------------------|
22
+ | mT5 | 1.69 | 277M | 101 | T5 | CC$^b$ | [Xue et al. 2021](https://doi.org/10.18653/v1/2021.naacl-main.41) |
23
+ | LASER | 1.64 | 52M | 93 | BiLSTM | OPUS$^c$ | [Artetxe and Schwenk 2019](https://doi.org/10.1162/tacl_a_00288) |
24
  | mBERT | 1.49 | 177M | 104 | BERT | Wiki | [Devlin et al. 2019](https://doi.org/10.18653/v1/N19-1423) |
25
+ | MPNet** | 1.38 | 278M | 53 | XLM-R | OPUS$^c$, MUSE$^d$, Wikititles$^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
26
+ | XLM-R-dist** | 1.37 | 278M | 53 | XLM-R | OPUS$^c$, MUSE$^d$, Wikititles$^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
27
  | XLM-R | 1.37 | 278M | 100 | XLM-R | CC | [Conneau et al. 2020](https://doi.org/10.18653/v1/2020.acl-main.747) |
28
  | LaBSE | 1.36 | 470M | 109 | BERT | CC, Wiki + mined bitexts | [Feng et al. 2020](https://arxiv.org/abs/2007.01852) |
29
  | DistilmBERT | 0.79 | 134M | 104 | BERT | Wiki | [Sanh et al. 2020](https://arxiv.org/abs/1910.01108) |
30
+ | mUSE-dist** | 0.79 | 134M | 53 | DistilmBERT | OPUS$^c$, MUSE$^d$, Wikititles$^e$ | [Reimers and Gurevych 2020](https://doi.org/10.18653/v1/2020.emnlp-main.365) |
31
  | mUSE-transformer* | 0.65 | 85M | 16 | transformer | mined QA + bitexts, SNLI | [Yang et al. 2020](https://doi.org/10.18653/v1/2020.acl-demos.12) |
32
  | mUSE-cnn* | 0.12 | 68M | 16 | CNN | mined QA + bitexts, SNLI | [Yang et al. 2020](https://doi.org/10.18653/v1/2020.acl-demos.12) |"""
33