sanchit-gandhi HF staff commited on
Commit
a1edac1
1 Parent(s): 3b18ca7

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +10 -2
app.py CHANGED
@@ -102,8 +102,16 @@ st.markdown("# XTREME-S: Evaluating Cross-lingual Speech Representations")
102
  st.markdown(
103
  f"""
104
  This is the leaderboard of the XTREME-S benchmark.
105
- Submitted systems are ranked by the **ESB Score** which is the average of
106
- all non-optional datasets: {", ".join(TEST_SETS)}. The optional dataset of f-r5 does not contribute to the average score."""
 
 
 
 
 
 
 
 
107
  )
108
 
109
  # st.table(table)
 
102
  st.markdown(
103
  f"""
104
  This is the leaderboard of the XTREME-S benchmark.
105
+ Submitted systems are ranked by the **average score**, which is a weighted average of
106
+ the mandatory test sets:
107
+ \n
108
+ $$
109
+ \begin{gathered}
110
+ 0.4 *\left(100-\frac{\text{Fleurs}+\text{MLS}+\text{VP}}{3}\right)_{(\mathrm{WER})}+ \\
111
+ 0.4 * \text{CoVoST}-2_{(\mathrm{BLEU})}+0.2 *\left(\frac{\text{F-LID}+\text{M-14}{2}\right)_{(\mathrm{Acc})}
112
+ $$
113
+ \end{gathered}
114
+ \nThe optional dataset of f-r5 does not contribute to the average score."""
115
  )
116
 
117
  # st.table(table)