Space: d-matrix/dmx_perplexity
title: DmxPerplexity
sdk: gradio
license: apache-2.0
tags: evaluate, metric
description: Perplexity metric implemented by d-Matrix. Perplexity (PPL) is one of the most common metrics for evaluating language models. It is defined as the exponentiated average negative log-likelihood of a sequence, calculated with exponent base `e`. Note that this metric is intended for Causual Language Models, the perplexity calculation is only correct if model uses Cross Entropy Loss. For more information, see https://huggingface.co/docs/transformers/perplexity
Tags: gradio, evaluate, metric, region:us