Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,7 @@ inference: false
|
|
21 |
|
22 |
This learned metric is for evaluating models trained on the TaTA dataset. It was trained as per instructions in [TaTA: A Multilingual Table-to-Text Dataset for African Languages](https://aclanthology.org/2023.findings-emnlp.118/).
|
23 |
|
24 |
-
It achieves a Pearson correlation of 0.23 with human evaluations on the test split ("attributable" column of [this dataset](https://huggingface.co/datasets/adenhaus/stata)).
|
25 |
|
26 |
[Here](https://huggingface.co/adenhaus/mt5-large-stata/blob/main/README.md) is a version trained with mT5-Large instead of mT5-Small, which achieves a correlation of 0.59.
|
27 |
|
|
|
21 |
|
22 |
This learned metric is for evaluating models trained on the TaTA dataset. It was trained as per instructions in [TaTA: A Multilingual Table-to-Text Dataset for African Languages](https://aclanthology.org/2023.findings-emnlp.118/).
|
23 |
|
24 |
+
It achieves an RMSE loss of 0.41 on the dev split, and a Pearson correlation of 0.23 with human evaluations on the test split ("attributable" column of [this dataset](https://huggingface.co/datasets/adenhaus/stata)).
|
25 |
|
26 |
[Here](https://huggingface.co/adenhaus/mt5-large-stata/blob/main/README.md) is a version trained with mT5-Large instead of mT5-Small, which achieves a correlation of 0.59.
|
27 |
|