Space: nhop/L3Score
title: L3Score
datasets: google/spiqa
tags: evaluate, metric, semantic-similarity, qa, llm-eval
description: L3Score is a metric for evaluating the semantic similarity of free-form answers in question answering tasks. It uses log-probabilities of "Yes"/"No" tokens from a language model acting as a judge. Based on the SPIQA benchmark: https://arxiv.org/pdf/2407.09413

sdk: gradio
Tags: gradio, evaluate, metric, semantic-similarity, qa, llm-eval, region:us