GitHub repository: pareto-ai/evals
Description: Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.