🚀 Qwen2.5-3B Fine-Tuned on BBH (Disambiguation QA) - Model Card 📌 Model Overview Model Name: Qwen2.5-3B Fine-Tuned on BBH (Disambiguation QA) Base Model: Qwen2.5-3B-Instruct Fine-Tuned Dataset: BBH (BigBench Hard) - Disambiguation QA Task: Causal Language Modeling (CLM) Fine-Tuning Objective: Improve performance on pronoun disambiguation and antecedent reasoning tasks 📌 Dataset Information This model was fine-tuned on the Disambiguation QA subset of the BigBench Hard (BBH) dataset.
Dataset characteristics:
Task Type: Pronoun resolution & antecedent disambiguation Input Format: Multiple-choice questions (MCQ) with ambiguous pronouns Target Labels: (A), (B), (C), or Ambiguous Example:
Input: "In the following sentences, explain the antecedent of the pronoun (which thing the pronoun refers to), or state that it is ambiguous. Sentence: The patient was referred to the specialist because he had a rare skin condition. Options: (A) The patient had a skin condition (B) The specialist had a skin condition (C) Ambiguous"
Target: (A)
This dataset evaluates a model's ability to correctly resolve pronouns in ambiguous sentences, which is crucial for natural language understanding (NLU), legal/medical document processing, and AI explainability.
- Downloads last month
- 3