Instruction:
Task: self_grade
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: eval
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: TypeScript
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: eval
Topic: Failure engineering and resilience testing
Difficulty: advanced
Language: SQL
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: failure_analysis
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: TypeScript
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: compare
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: advanced
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: Python
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: eval
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: failure_analysis
Topic: Model merging, distillation, and continual learning
Difficulty: advanced
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: self_grade
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 9,
  "confidence": 0.9,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: design
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: advanced
Language: C#
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: compare
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: self_grade
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: patch_diff
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: Rust
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: self_grade
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: Python
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 6,
  "confidence": 0.6,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: data_pipeline
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: Go
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: code
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Go
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: TypeScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: agent_loop
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: C#
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Latency, cost, throughput optimization
Difficulty: advanced
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: Python
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: review
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: Rust
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: Go
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Extended context, memory, and repo graphs
Difficulty: expert
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Rust
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: code
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: Bash
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: self_grade
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: advanced
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 7,
  "confidence": 0.7,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: failure_analysis
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: eval
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: SQL
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: design
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: Java
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Tool calling protocols and sandboxed execution
Difficulty: advanced
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: SQL
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Self-grading and automated model critique
Difficulty: expert
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: explain
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Python
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: advanced
Language: Bash
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: code
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: SQL
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Extended context, memory, and repo graphs
Difficulty: expert
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 9,
  "confidence": 0.9,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: agent_loop
Topic: Tool calling protocols and sandboxed execution
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Go
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Tool calling protocols and sandboxed execution
Difficulty: advanced
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: Rust
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Java
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: tool_trace
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: review
Topic: Model merging, distillation, and continual learning
Difficulty: advanced
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Self-grading and automated model critique
Difficulty: expert
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: TypeScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 9,
  "confidence": 0.9,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: design
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Rust
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: code
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: TypeScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 7,
  "confidence": 0.7,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: self_grade
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Bash
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: data_pipeline
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: JavaScript
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: agent_loop
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: Rust
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: Rust
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: agent_loop
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: TypeScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: explain
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: Go
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Latency, cost, throughput optimization
Difficulty: advanced
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: eval
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: review
Topic: Multi-agent coordination and role separation
Difficulty: advanced
Language: Java
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Latency, cost, throughput optimization
Difficulty: advanced
Language: SQL
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: patch_diff
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: Python
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: eval
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: Rust
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: explain
Topic: Latency, cost, throughput optimization
Difficulty: advanced
Language: C#
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Python
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 6,
  "confidence": 0.6,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: code
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: Rust
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: C#
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: explain
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 10,
  "confidence": 1.0,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: explain
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: Bash
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 9,
  "confidence": 0.9,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: compare
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: SQL
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Self-grading and automated model critique
Difficulty: expert
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: advanced
Language: Go
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: Rust
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: C#
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: eval
Topic: Failure engineering and resilience testing
Difficulty: advanced
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: data_pipeline
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Bash
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Bash
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: explain
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: SQL
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: TypeScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: advanced
Language: Bash
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: tool_trace
Topic: Extended context, memory, and repo graphs
Difficulty: expert
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: explain
Topic: Latency, cost, throughput optimization
Difficulty: advanced
Language: SQL
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: TypeScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 6,
  "confidence": 0.6,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: data_pipeline
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Bash
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: Bash
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: explain
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: advanced
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: Bash
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: TypeScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Tool calling protocols and sandboxed execution
Difficulty: advanced
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: Go
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 10,
  "confidence": 1.0,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: tool_trace
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: Go
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: tool_trace
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: agent_loop
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: advanced
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: Java
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: code
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: SQL
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Agentic coding systems (plan→edit→test→reflect)
Difficulty: expert
Language: TypeScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: Java
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: Bash
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: self_grade
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Go
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 10,
  "confidence": 1.0,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: agent_loop
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: Python
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: Java
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: patch_diff
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: eval
Topic: Governance, provenance, and audit logging
Difficulty: advanced
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: tool_trace
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: C#
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: failure_analysis
Topic: Self-grading and automated model critique
Difficulty: expert
Language: SQL
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: compare
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: advanced
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Rust
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: Go
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: agent_loop
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Self-grading and automated model critique
Difficulty: expert
Language: Rust
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: eval
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: SQL
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: eval
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Bash
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: failure_analysis
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: Python
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: tool_trace
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: Go
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: design
Topic: Model merging, distillation, and continual learning
Difficulty: advanced
Language: JavaScript
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Bash
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: failure_analysis
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: self_grade
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: SQL
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 7,
  "confidence": 0.7,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: explain
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Python
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: compare
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: C#
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Go
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: Rust
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Model merging, distillation, and continual learning
Difficulty: advanced
Language: SQL
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: Python
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Failure engineering and resilience testing
Difficulty: expert
Language: Rust
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: compare
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: review
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Tool calling protocols and sandboxed execution
Difficulty: expert
Language: Go
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: data_pipeline
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: failure_analysis
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: C#
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: design
Topic: Extended context, memory, and repo graphs
Difficulty: expert
Language: JavaScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: SQL
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: self_grade
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: advanced
Language: Bash
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 6,
  "confidence": 0.6,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: self_grade
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 10,
  "confidence": 1.0,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: self_grade
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: C#
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 6,
  "confidence": 0.6,
  "notes": "Passed tests; minimal diff; no security flags."
}


Instruction:
Task: compare
Topic: Secure code generation, red-teaming, and policy gates
Difficulty: expert
Language: Java
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: explain
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Java
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: TypeScript
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: failure_analysis
Topic: Multi-agent coordination and role separation
Difficulty: advanced
Language: Bash
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: failure_analysis
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: patch_diff
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: C#
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: explain
Topic: Model merging, distillation, and continual learning
Difficulty: expert
Language: C#
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: advanced
Language: C#
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: review
Topic: Multi-agent coordination and role separation
Difficulty: expert
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: C#
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Reasoning-first coding models and tunable deliberation
Difficulty: expert
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: design
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: tool_trace
Topic: Tool calling protocols and sandboxed execution
Difficulty: advanced
Language: Python
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: data_pipeline
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: Java
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Extended context, memory, and repo graphs
Difficulty: advanced
Language: Python
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: failure_analysis
Topic: Extended context, memory, and repo graphs
Difficulty: expert
Language: Rust
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Failure: regression detected
Cause: missing edge case
Fix: add guard + test


Instruction:
Task: eval
Topic: Latency, cost, throughput optimization
Difficulty: expert
Language: JavaScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: data_pipeline
Topic: Dataset curation pipelines and quality attribution
Difficulty: advanced
Language: Python
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: patch_diff
Topic: Governance, provenance, and audit logging
Difficulty: expert
Language: JavaScript
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Patch:
```diff
- result = a / b
+ if b == 0:
+     raise ValueError('division by zero')
+ result = a / b

```


Instruction:
Task: design
Topic: Mixture-of-Experts (MoE) routing and sparsity
Difficulty: expert
Language: Rust
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: review
Topic: Code-specialized model families and scaling laws
Difficulty: advanced
Language: JavaScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: eval
Topic: Multi-agent coordination and role separation
Difficulty: advanced
Language: Bash
Context: Research benchmark validation environment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: tool_trace
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: TypeScript
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

[
  {
    "tool": "repo_checkout",
    "args": {
      "commit": "abc123"
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "unit"
    }
  },
  {
    "tool": "apply_patch",
    "args": {
      "files": 1
    }
  },
  {
    "tool": "run_tests",
    "args": {
      "suite": "full"
    }
  }
]


Instruction:
Task: eval
Topic: Dataset curation pipelines and quality attribution
Difficulty: expert
Language: Go
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Metrics:
- pass@k
- time-to-green
- cost-per-fix
- regression rate


Instruction:
Task: agent_loop
Topic: Self-grading and automated model critique
Difficulty: advanced
Language: Bash
Context: Offline air-gapped deployment
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: data_pipeline
Topic: SWE-bench real-repo evaluation and leakage control
Difficulty: expert
Language: TypeScript
Context: Latency-critical production API
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: agent_loop
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Rust
Context: Large monorepo with flaky tests and strict CI
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

Expert guidance with risks, metrics, and governance controls.


Instruction:
Task: self_grade
Topic: Code-specialized model families and scaling laws
Difficulty: expert
Language: Java
Context: Regulated enterprise with audit requirements
Produce frontier-grade, production-valid output.

Output:
Facts:
- Modern AI coding success is measured by test pass rates, iteration cost, and reliability.
- Agentic and multi-agent systems outperform single-pass generation.

{
  "score": 8,
  "confidence": 0.8,
  "notes": "Passed tests; minimal diff; no security flags."
}