Repository: pytorch/benchmark
Issue: V3 Performance Signal Detected by TorchBench Userbenchmark "torch-nightly" on '7d163a986134babccca102d575db123974e95d83'
Root cause: Algorithmic Error


TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: ef28de986bb0540a4cd8f569f7b0b973a2ae26f6

Affected PyTorch commit: 7d163a986134babccca102d575db123974e95d83

Affected Tests:
- test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_latency: -13.88121%


Tests that were no longer run on affected commit:


Tests that were newly added on affected commit:


Runtime regressions found?
No runtime errors were found in the new benchmarks run--you are all good there!

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/7358074988

cc @xuzhao9


https://github.com/pytorch/benchmark/actions/runs/7429045261

```
{
  "target_repo": "pytorch",
  "start": "6375eb15efa1273514695e468f68963feedc0067",
  "end": "ef94499ad7ff40fee8aa230d71cd109570b74405",
  "result": [
    {
      "commit1": "cab79ceb51e",
      "commit1_time": "2023-12-29 02:49:37 +0000",
      "commit1_digest": {
        "name": "torch-nightly",
        "environ": {
          "pytorch_git_version": "cab79ceb51e1a7c608dafc209ad3059fa9b15de4",
          "pytorch_version": "2.3.0a0+gitcab79ce",
          "device": "NVIDIA A100-SXM4-40GB",
          "git_commit_hash": "cab79ceb51e1a7c608dafc209ad3059fa9b15de4"
        },
        "metrics": {
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_latency": 22.832377,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_cmem": 0.9306640625,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_gmem": 2.97943115234375
        }
      },
      "commit2": "240121587ac",
      "commit2_time": "2023-12-29 03:08:39 +0000",
      "commit2_digest": {
        "name": "torch-nightly",
        "environ": {
          "pytorch_git_version": "240121587ac8999aa22411395373a5a98061d863",
          "pytorch_version": "2.3.0a0+git2401215",
          "device": "NVIDIA A100-SXM4-40GB",
          "git_commit_hash": "240121587ac8999aa22411395373a5a98061d863"
        },
        "metrics": {
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_latency": 24.967351,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_cmem": 0.9423828125,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_gmem": 2.97943115234375
        }
      }
    },
    {
      "commit1": "240121587ac",
      "commit1_time": "2023-12-29 03:08:39 +0000",
      "commit1_digest": {
        "name": "torch-nightly",
        "environ": {
          "pytorch_git_version": "240121587ac8999aa22411395373a5a98061d863",
          "pytorch_version": "2.3.0a0+git2401215",
          "device": "NVIDIA A100-SXM4-40GB",
          "git_commit_hash": "240121587ac8999aa22411395373a5a98061d863"
        },
        "metrics": {
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_latency": 24.967351,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_cmem": 0.9423828125,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_gmem": 2.97943115234375
        }
      },
      "commit2": "ef94499ad7f",
      "commit2_time": "2023-12-29 03:13:51 +0000",
      "commit2_digest": {
        "name": "torch-nightly",
        "environ": {
          "pytorch_git_version": "ef94499ad7ff40fee8aa230d71cd109570b74405",
          "pytorch_version": "2.3.0a0+gitef94499",
          "device": "NVIDIA A100-SXM4-40GB",
          "git_commit_hash": "ef94499ad7ff40fee8aa230d71cd109570b74405"
        },
        "metrics": {
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_latency": 22.679075,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_cmem": 0.8603515625,
          "test_eval[detectron2_fasterrcnn_r_50_dc5-cuda-eager]_gmem": 2.97943115234375
        }
      }
    }
  ]
}
```