Hugging Face Space: BridgeAI-Lab/SemF1
Author: BridgeAI-Lab
SDK: gradio
title: SemF1
tags: evaluate
metric
description: SEM-F1 metric leverages the pre-trained contextual embeddings and evaluates the model generated semantic overlap  summary with the reference overlap summary. It evaluates the semantic overlap summary at the sentence level and  computes precision, recall and F1 scores.
Refer to the paper `SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale`  for more details. 
authors: nbansal