Hugging Face Space: d-matrix/dmx_perplexity
Author: d-matrix
SDK: gradio
title: DmxPerplexity
license: apache-2.0
tags: evaluate
metric
description: Perplexity metric implemented by d-Matrix. Perplexity (PPL) is one of the most common metrics for evaluating language models. It is defined as the exponentiated average negative log-likelihood of a sequence, calculated with exponent base `e`. Note that this metric is intended for Causual Language Models, the perplexity calculation is only correct if model uses Cross Entropy Loss. For more information, see https://huggingface.co/docs/transformers/perplexity