Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on '2.0.0.dev20221221+cu116'
Root cause: Others


TorchBench CI has detected a performance signal.

Base PyTorch version: 2.0.0.dev20221220+cu116

Base PyTorch commit: d6dd2e97da619319a103d1061290fe33ce33b6a4

Affected PyTorch version: 2.0.0.dev20221221+cu116

Affected PyTorch commit: 5d37890b8eb952560f22b1b8ff661a024bf4b6d9

Affected Tests:
- test_train[Super_SloMo-cuda-jit]: -27.75537%
- test_eval[Super_SloMo-cuda-jit]: -36.74641%
- test_train[Super_SloMo-cuda-eager]: -27.69495%
- test_eval[Super_SloMo-cuda-eager]: -36.52676%
- test_eval[drq-cuda-eager]: -9.33913%
- test_train[maml-cuda-eager]: -29.73327%
- test_eval[maml-cuda-eager]: -31.00988%
- test_train[maml_omniglot-cuda-eager]: -10.67537%
- test_eval[maml_omniglot-cuda-eager]: -14.73753%
- test_eval[opacus_cifar10-cuda-eager]: -11.87648%
- test_train[pytorch_unet-cuda-jit]: -39.20650%
- test_eval[pytorch_unet-cuda-jit]: -24.45920%
- test_train[pytorch_unet-cuda-eager]: -39.22706%
- test_eval[pytorch_unet-cuda-eager]: -23.09009%
- test_train[yolov3-cuda-eager]: -37.11652%
- test_eval[yolov3-cuda-eager]: -34.42385%


cc @xuzhao9

Result json: 
```
{
  "start": "d6dd2e97da619319a103d1061290fe33ce33b6a4",
  "end": "5d37890b8eb952560f22b1b8ff661a024bf4b6d9",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "28ceccec214",
      "commit1_time": "2022-12-20 18:13:19 +0000",
      "commit1_digest": {
        "test_train[Super_SloMo-cuda-jit]": 1.6030066374631133,
        "test_eval[Super_SloMo-cuda-jit]": 0.9871502244030126,
        "test_train[Super_SloMo-cuda-eager]": 1.6061259943642654,
        "test_eval[Super_SloMo-cuda-eager]": 0.988760449399706,
        "test_eval[drq-cuda-eager]": 0.002429991565799509,
        "test_train[maml-cuda-eager]": 0.9541063819080591,
        "test_eval[maml-cuda-eager]": 0.053888243850087746,
        "test_train[maml_omniglot-cuda-eager]": 5.668571672326652,
        "test_eval[maml_omniglot-cuda-eager]": 0.0012117913450910372,
        "test_eval[opacus_cifar10-cuda-eager]": 0.006211410758160749,
        "test_train[pytorch_unet-cuda-jit]": 0.803317311295541,
        "test_eval[pytorch_unet-cuda-jit]": 0.2060070853913203,
        "test_train[pytorch_unet-cuda-eager]": 0.8033134770696051,
        "test_eval[pytorch_unet-cuda-eager]": 0.21759842711035163,
        "test_train[yolov3-cuda-eager]": 1.4266737892176025,
        "test_eval[yolov3-cuda-eager]": 0.35730046283570116
      },
      "commit2": "dabf515c184",
      "commit2_time": "2022-12-20 18:52:29 +0000",
      "commit2_digest": {
        "test_train[Super_SloMo-cuda-jit]": 1.158269446954364,
        "test_eval[Super_SloMo-cuda-jit]": 0.6241791766195093,
        "test_train[Super_SloMo-cuda-eager]": 1.1614526704943273,
        "test_eval[Super_SloMo-cuda-eager]": 0.6250207095989027,
        "test_eval[drq-cuda-eager]": 0.002208589116500142,
        "test_train[maml-cuda-eager]": 0.6670906367420685,
        "test_eval[maml-cuda-eager]": 0.037036066741815636,
        "test_train[maml_omniglot-cuda-eager]": 5.07415850929101,
        "test_eval[maml_omniglot-cuda-eager]": 0.0010163969087774274,
        "test_eval[opacus_cifar10-cuda-eager]": 0.005498107222361665,
        "test_train[pytorch_unet-cuda-jit]": 0.48870485903462396,
        "test_eval[pytorch_unet-cuda-jit]": 0.15571521883830428,
        "test_train[pytorch_unet-cuda-eager]": 0.4884229981515091,
        "test_eval[pytorch_unet-cuda-eager]": 0.16735917596379296,
        "test_train[yolov3-cuda-eager]": 0.8974589520017616,
        "test_eval[yolov3-cuda-eager]": 0.23426561440574006
      }
    }
  ]
}
```
Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/3751436895


Known speedup, closed.