Space: qlemesle/parapluie
title: ParaPLUIE
tags: evaluate, metric
description: ParaPLUIE is a metric for evaluating the semantic proximity between two sentences. ParaPLUIE uses the perplexity of an LLM to compute a confidence score. It has shown the highest correlation with human judgment on paraphrase classification while maintaining a low computational cost, as it roughly equivalent to the cost of generating a single token.
sdk: static
short_description: ParaPLUIE is a metric for evaluating the semantic proximity
Tags: static, evaluate, metric, region:us