aec-bench/release-model-rollouts
Viewer • Updated • 53.6k • 15
None defined yet.
AEC-Bench is an open benchmark and Python toolkit for evaluating agentic AI systems on realistic Architecture, Engineering, and Construction tasks.
The project combines generated engineering tasks, executable verifiers, model rollout ledgers, and trace artifacts so evaluation can be inspected beyond a single leaderboard score: by task family, difficulty, information visibility, tool use, cost, and failure mode.