GitHub repository: m1chae11u/Guess-the-Rule-LLM-Benchmark
Primary language: Python
Created: 2024-09-27T01:31:47Z
Description: A dynamically reusable benchmark designed to evaluate Large Language Models’ abstract reasoning capabilities through continuously generated “Guess the Rule” games. This repository features an automated rule generation system, customizable APIs for on-demand dataset creation, and an interactive game interface for robust and scalable LLM assessment.