Omkar2118/datasets huggingface dataset:
Demetr

**Demetr** is a diagnostic dataset with 31K English examples (translated from 10 source languages) for evaluating the sensitivity of MT evaluation metrics to 35 different linguistic perturbations spanning semantic, syntactic, and morphological error categories.

Source: [DEMETR: Diagnosing Evaluation Metrics for Translation](https://arxiv.org/pdf/2210.13746v1.pdf)

Image Source: [https://arxiv.org/pdf/2210.13746v1.pdf](https://arxiv.org/pdf/2210.13746v1.pdf)

Introducing paper: DEMETR: Diagnosing Evaluation Metrics for Translation