Omkar2118/datasets huggingface dataset:
JustLogic

JustLogic is a natural language deductive reasoning dataset. JustLogic is (i) highly complex, capable of generating a diverse range of linguistic patterns, vocabulary, and argument structures; (ii) prior knowledge independent, eliminating the advantage of models possessing prior knowledge and ensuring that only deductive reasoning is used to answer questions; and (iii) capable of in-depth error analysis on the heterogeneous effects of reasoning depth and argument form on model accuracy.

Introducing paper: JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Models