Model: Netta1994/setfit_baai_squad_gpt-4o_improved-cot-instructions_chat_few_shot_generated_only_reaso
Author: Netta1994
Pipeline: text-classification
Library: setfit
Tags: setfit, safetensors, bert, sentence-transformers, text-classification, generated_from_setfit_trainer, arxiv:2209.11055, base_model:BAAI/bge-base-en-v1.5, base_model:finetune:BAAI/bge-base-en-v1.5, model-index, region:us
Base models (finetune): id: BAAI/bge-base-en-v1.5
Card metadata: base_model: BAAI/bge-base-en-v1.5
library_name: setfit
metrics: accuracy
pipeline_tag: text-classification
tags: setfit, sentence-transformers, text-classification, generated_from_setfit_trainer
widget: Reasoning:
The answer accurately states that Forbes began reporting Beyoncé's annual earnings in 2008, which is confirmed by the document. It correctly addresses the specific question and avoids any deviation into unrelated topics, making it both relevant and concise. The mention of the misconception about Times Magazine is brief and does not detract from the main point, providing context without unnecessary elaboration.

Evaluation: Good, Reasoning:
The provided answer states, "The average student at Notre Dame travels more than 750 miles to study there," which directly addresses the question asked. The document confirms the accuracy of this information with the statement, "the average student traveled more than 750 miles to Notre Dame." The answer is well-grounded in the document, relevant to the specific question, and concise without extraneous information.

Evaluation: Good, Reasoning:
The provided answer correctly identifies Mick LaSalle as the writer for the San Francisco Chronicle who awarded "Spectre" with a perfect score. This is directly supported by the document, which states, "Other positive reviews from Mick LaSalle from the San Francisco Chronicle, gave it a perfect 100 score..."

Evaluation: Good, Reasoning:
The answer states that Queens contains the highest population of Asian-Americans among all the boroughs of New York, which is consistent with the provided document. The document clearly mentions that Queens is home to the state's largest Asian American population. The answer is directly relevant to the question and stays focused without providing unnecessary details.
Evaluation: Good, Reasoning:
The answer provided states that "The opening of a theology library at Notre Dame occurred in the year 2015." This is indeed correct and supported by the document. However, the question asked about the year when Doctorate degrees were first granted at Notre Dame, not about the opening of the theology library. The answer does not address the specific question asked and thus lacks relevance to the query.

Evaluation: Bad
inference: yes
model-index: name: SetFit with BAAI/bge-base-en-v1.5
results: task: type: text-classification
name: Text Classification
dataset: name: Unknown
type: unknown
split: test
metrics: type: accuracy
value: 0.9180327868852459
name: Accuracy
verified: no
Likes: 0 | All-time downloads: 10
Created: 2024-09-19 13:46:56