Back to all metrics
Metric: sacrebleu πŸ“‰
Update on GitHub

How to load this metric directly with the πŸ€—/datasets library:

Copy to clipboard
from datasets import load_metric metric = load_metric("sacrebleu")


SacreBLEU provides hassle-free computation of shareable, comparable, and reproducible BLEU scores. Inspired by Rico Sennrich's `multi-bleu-detok.perl`, it produces the official WMT scores but works with plain text. It also knows all the standard test sets and handles downloading, processing, and tokenization for you. See the [] file at for more information.


    title = "A Call for Clarity in Reporting {BLEU} Scores",
    author = "Post, Matt",
    booktitle = "Proceedings of the Third Conference on Machine Translation: Research Papers",
    month = oct,
    year = "2018",
    address = "Belgium, Brussels",
    publisher = "Association for Computational Linguistics",
    url = "",
    pages = "186--191",