Space: aynetdia/semscore
title: SemScore
tags: evaluate, metric
description: SemScore measures semantic textual similarity between candidate and reference texts. It has been shown to strongly correlate with human judgment on a system-level when evaluating the instructing following capabilities of language models. Given a set of model-generated outputs and target completions, a pre-trained sentence-transformer is used to calculate cosine similarities between them.
sdk: gradio
Tags: gradio, evaluate, metric, region:us