Model: Netta1994/setfit_baai_squad_gpt-4o_cot-few_shot-instructions_remove_final_evaluation_e1_larger_
Author: Netta1994
Pipeline: text-classification
Library: setfit
Tags: setfit, safetensors, bert, sentence-transformers, text-classification, generated_from_setfit_trainer, arxiv:2209.11055, base_model:BAAI/bge-base-en-v1.5, base_model:finetune:BAAI/bge-base-en-v1.5, model-index, region:us
Base models (finetune): id: BAAI/bge-base-en-v1.5
Card metadata: base_model: BAAI/bge-base-en-v1.5
library_name: setfit
metrics: accuracy
pipeline_tag: text-classification
tags: setfit, sentence-transformers, text-classification, generated_from_setfit_trainer
widget: Reasoning:
1. Context Grounding: The answer correctly identifies Forbes as the magazine that began reporting Beyoncé's annual earnings in 2008, which is directly supported by the document.
2. Relevance: The answer accurately addresses the specific question of who began reporting Beyoncé's annual earnings starting in 2008.
3. Conciseness: The answer is straight to the point and does not include unnecessary information.

Final Evaluation:, Reasoning:
1. Context Grounding: The answer "The average student at Notre Dame travels more than 750 miles to study there" is well-supported by the document, which states that admitted students on average traveled more than 750 miles.
2. Relevance: The answer directly addresses the question about the distance traveled by the average student at Notre Dame.
3. Conciseness: The answer is clear, concise, and directly to the point without unnecessary information.

Final Evaluation:, The answer correctly addresses the question by specifying that Mick LaSalle is the writer for the San Francisco Chronicle who awarded Spectre with a perfect score. The response is directly supported by the provided document, making it contextually grounded. The information is relevant to the question asked and is concise.

Final evaluation:, Evaluation:
The answer is directly related to the provided question and is well-supported by the document. The document explicitly states that Queens is home to the state's largest Asian American population, confirming that Queens contains the highest population of Asian-Americans among the New York boroughs. The answer is concise and does not include unnecessary information.

Final evaluation:, Evaluation:
The answer provided does not address the specific question asked about the year when Doctorate degrees were first granted at Notre Dame. Instead, it discusses the opening of a theology library, which is irrelevant to the question. This indicates a lack of context grounding and relevance.

Final evaluation:
inference: yes
model-index: name: SetFit with BAAI/bge-base-en-v1.5
results: task: type: text-classification
name: Text Classification
dataset: name: Unknown
type: unknown
split: test
metrics: type: accuracy
value: 0.9180327868852459
name: Accuracy
verified: no
Likes: 0 | All-time downloads: 10
Created: 2024-09-22 15:35:38