Space: BridgeAI-Lab/SemF1
title: SemF1
tags: evaluate, metric
sdk: gradio
description: SEM-F1 metric leverages the pre-trained contextual embeddings and evaluates the model generated semantic overlap  summary with the reference overlap summary. It evaluates the semantic overlap summary at the sentence level and  computes precision, recall and F1 scores.
Refer to the paper `SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale`  for more details. 
authors: nbansal
Tags: gradio, evaluate, metric, region:us