Spaces:
Runtime error
Runtime error
Commit
•
a1edac1
1
Parent(s):
3b18ca7
Update app.py
Browse files
app.py
CHANGED
@@ -102,8 +102,16 @@ st.markdown("# XTREME-S: Evaluating Cross-lingual Speech Representations")
|
|
102 |
st.markdown(
|
103 |
f"""
|
104 |
This is the leaderboard of the XTREME-S benchmark.
|
105 |
-
Submitted systems are ranked by the **
|
106 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
107 |
)
|
108 |
|
109 |
# st.table(table)
|
|
|
102 |
st.markdown(
|
103 |
f"""
|
104 |
This is the leaderboard of the XTREME-S benchmark.
|
105 |
+
Submitted systems are ranked by the **average score**, which is a weighted average of
|
106 |
+
the mandatory test sets:
|
107 |
+
\n
|
108 |
+
$$
|
109 |
+
\begin{gathered}
|
110 |
+
0.4 *\left(100-\frac{\text{Fleurs}+\text{MLS}+\text{VP}}{3}\right)_{(\mathrm{WER})}+ \\
|
111 |
+
0.4 * \text{CoVoST}-2_{(\mathrm{BLEU})}+0.2 *\left(\frac{\text{F-LID}+\text{M-14}{2}\right)_{(\mathrm{Acc})}
|
112 |
+
$$
|
113 |
+
\end{gathered}
|
114 |
+
\nThe optional dataset of f-r5 does not contribute to the average score."""
|
115 |
)
|
116 |
|
117 |
# st.table(table)
|