Multilingual Scoreboard?

#15
by aari1995 - opened

It would be great to have also an evaluation for multilingual results, such as German or Spanish. This could be done with MT the datasets. Any interest?

Maybe something for a seperate leaderboard?

Would love to see this for Japanese.

If not a multi-lingual scoreboard, at the very least, the existing leaderboard could have in the info for each entry, a list of languages that were represented appreciably in the training set and/or a list of languages that the model has a reasonable degree of competence with (e.g., it might be useful for some tasks in that language).

I think it would make sense to do this but in another leaderboard - however, we can add the fact that this leaderboard is evaluating on English

SaylorTwift changed discussion status to closed

Sign up or log in to comment