Title: BuildArena: A Physics‑Aligned Interactive Benchmark of LLMs for Engineering Construction
Primary area: datasets and benchmarks
Keywords: Engineering construction, LLM, benchmark

Abstract: Engineering construction automation aims to transform natural language specifications into physically viable structures, requiring complex integrated reasoning under strict physical constraints. While modern LLMs possess broad knowledge and strong reasoning capabilities that make them promising candidates for this domain, their construction competencies remain largely unevaluated. To address this gap, we introduce \proj, the first physics-aligned interactive benchmark designed for language-driven engineering construction. It contributes to the community in four aspects: (1) a highly customizable benchmarking framework for in-depth comparison and analysis of LLMs; (2) an extendable task design strategy spanning static and dynamic mechanics across multiple difficulty tiers; (3) a 3D Spatial Geometric Computation Library for supporting construction based on language instructions; (4) a baseline LLM agentic workflow that effectively evaluates diverse model capabilities. On eight frontier LLMs, \proj comprehensively evaluates their capabilities for language-driven and physics-grounded construction automation. We release the code at https://anonymous.4open.science/r/BuildArena-9B7B/ to benefit construction automation in engineering applications.

TL;DR: We provide BuildArena, a physics‑aligned interactive benchmark that tests the engineering construction capabilities of frontier LLMs.