adenhaus commited on
Commit
9d43e00
1 Parent(s): cdc3165

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -21,7 +21,7 @@ inference: false
21
 
22
  This learned metric is for evaluating models trained on the TaTA dataset. It was trained as per instructions in [TaTA: A Multilingual Table-to-Text Dataset for African Languages](https://aclanthology.org/2023.findings-emnlp.118/).
23
 
24
- It achieves a Pearson correlation of 0.23 with human evaluations on the test split ("attributable" column of [this dataset](https://huggingface.co/datasets/adenhaus/stata)).
25
 
26
  [Here](https://huggingface.co/adenhaus/mt5-large-stata/blob/main/README.md) is a version trained with mT5-Large instead of mT5-Small, which achieves a correlation of 0.59.
27
 
 
21
 
22
  This learned metric is for evaluating models trained on the TaTA dataset. It was trained as per instructions in [TaTA: A Multilingual Table-to-Text Dataset for African Languages](https://aclanthology.org/2023.findings-emnlp.118/).
23
 
24
+ It achieves an RMSE loss of 0.41 on the dev split, and a Pearson correlation of 0.23 with human evaluations on the test split ("attributable" column of [this dataset](https://huggingface.co/datasets/adenhaus/stata)).
25
 
26
  [Here](https://huggingface.co/adenhaus/mt5-large-stata/blob/main/README.md) is a version trained with mT5-Large instead of mT5-Small, which achieves a correlation of 0.59.
27