# Sabnock Docker Submissions

Agent submissions use JSONL: one JSON object per attempted task.

Required fields:

```json
{"agent":"my-agent","task_id":"sbd-0001","patch":"diff --git ..."}
```

Recommended optional fields:

```json
{
  "agent": "my-agent",
  "model": "provider/model",
  "task_id": "sbd-0001",
  "patch": "diff --git a/Dockerfile b/Dockerfile\n...",
  "runtime_seconds": 12.4,
  "cost_usd": 0.03,
  "attempt": 1
}
```

Score a submission file:

```bash
python3 -m sabnock_docker.cli score-submissions submissions.jsonl
```

Output columns:

```text
agent,attempted,passed,total_tasks,pass_rate,apply_rate,mean_score,errors
```

Leaderboard sorting should use:

1. `pass_rate`
2. `apply_rate`
3. lower `runtime_seconds`
4. lower `cost_usd`
5. lower patch size