GitHub repository: lukevs/evals
Description: Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.