Omkar2118/datasets huggingface dataset:
MedDistractQA-Nonliteral

Novel benchmark adapted from the MedQA, with confounding statements introduced within the question regarding an irrelevant clinical term used in a nonclinical context (e.g., The patient's Zodiac sign is Cancer).

Introducing paper: Medical large language models are easily distracted
MedDistractQA-Bystander

Novel benchmark adapted from the MedQA, with confounding statements introduced within the question regarding an irrelevant third party.

Introducing paper: Medical large language models are easily distracted