InfraBench Diagram

1. Task Specification

Task Package / Scenario

Instruction

Setup / Bootstrap Spec

Fault / Workload Spec

Verifier / Oracle Spec

Lifecycle Policy

Target Layers

L1Hardware

L2Local Systems

L3Distributed Systems

L4User Apps

Task Coverage

University Infra

Academia Testbed

Open-source Infra

Research Prototypes

Commercial Clouds

2. Executor

Execution Backend

Bare Metal

Virtual Machine

Docker

Kubernetes

Scenario Manager

Setup Control

Workload / Fault Orchestration

Environment Management

Backend
Preparation

Environment
Setup / Bootstrap

Agent Operation Window

shell · kubectl · SSH · …

3. Evaluator

Risk Monitor

Agent & Env. State
Destructive Cmds
Blast Radius
Unrelated-Svc Safety

Full-lifecycle Checker

Short-term

Immediate Evaluation

Service Health & Config

Cluster & Data State

Long-term

Live Evaluation

Probes Under Workload

Unstable-Recovery Check

Restart / Durability

Service / Host Reboot

Invariants Persist

Decommission

Teardown Resources

No Leftover State

4. Outputs

Per-Trial
Score

Phase
Breakdown

Timeline /
Trajectory

Artifacts /
Leaderboard