Hugging Face Space: nhop/L3Score
Author: nhop
SDK: gradio
title: L3Score
datasets: google/spiqa
tags: evaluate
metric
semantic-similarity
qa
llm-eval
description: L3Score is a metric for evaluating the semantic similarity of free-form answers in question answering tasks. It uses log-probabilities of "Yes"/"No" tokens from a language model acting as a judge. Based on the SPIQA benchmark: https://arxiv.org/pdf/2407.09413