Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on '2.3.0.dev20240209+cu121'
Root cause: Algorithmic Error


TorchBench CI has detected a performance signal.

Base PyTorch version: 2.3.0.dev20240208+cu121

Base PyTorch commit: 5f6b35915af98fac741998edb55aeeba4aaa3794

Affected PyTorch version: 2.3.0.dev20240209+cu121

Affected PyTorch commit: 930b60f5aa7e17402491900a545d96822796b638

Affected Tests:
- test_eval[pyhpc_equation_of_state-cpu-jit]: +36.85925%
- test_eval[pytorch_stargan-cpu-jit]: +20.47134%
- test_eval[resnext50_32x4d-cpu-jit]: -21.35752%
- test_eval[shufflenet_v2_x1_0-cpu-eager]: +17.62261%
- test_train[tts_angular-cpu-eager]: +7.40131%


cc @xuzhao9

Result json: 
```
{
  "start": "5f6b35915af98fac741998edb55aeeba4aaa3794",
  "end": "930b60f5aa7e17402491900a545d96822796b638",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "8da2f815279",
      "commit1_time": "2024-02-08 17:19:07 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2709827413316816
      },
      "commit2": "8182fce7691",
      "commit2_time": "2024-02-08 17:20:39 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.30077780969440937
      }
    },
    {
      "commit1": "def572929b2",
      "commit1_time": "2024-02-08 18:54:18 +0000",
      "commit1_digest": {
        "test_eval[pyhpc_equation_of_state-cpu-jit]": 0.0775369313545525,
        "test_eval[pytorch_stargan-cpu-jit]": 0.25228009140118957
      },
      "commit2": "91f038161ab",
      "commit2_time": "2024-02-08 19:04:30 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2748100669588894
      }
    },
    {
      "commit1": "db1a4dcb5ab",
      "commit1_time": "2024-02-08 20:35:32 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2712099047843367
      },
      "commit2": "7fd6b1c558d",
      "commit2_time": "2024-02-08 20:38:51 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.29627702762372793
      }
    },
    {
      "commit1": "b251bca205e",
      "commit1_time": "2024-02-08 17:07:30 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.30209496011957526
      },
      "commit2": "6d8f192fd05",
      "commit2_time": "2024-02-08 17:10:38 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2719372946768999
      }
    },
    {
      "commit1": "9242523ad59",
      "commit1_time": "2024-02-08 18:31:33 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2985880302730948
      },
      "commit2": "7ec6ac89e84",
      "commit2_time": "2024-02-08 18:42:40 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.27439660890959205
      }
    },
    {
      "commit1": "7ec6ac89e84",
      "commit1_time": "2024-02-08 18:42:40 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.27439660890959205
      },
      "commit2": "def572929b2",
      "commit2_time": "2024-02-08 18:54:18 +0000",
      "commit2_digest": {
        "test_eval[pyhpc_equation_of_state-cpu-jit]": 0.0775369313545525,
        "test_eval[pytorch_stargan-cpu-jit]": 0.25228009140118957
      }
    },
    {
      "commit1": "d9a1b258071",
      "commit1_time": "2024-02-08 21:06:34 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2975261735264212
      },
      "commit2": "a7754b2b60f",
      "commit2_time": "2024-02-08 21:18:39 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.25261512617580595
      }
    },
    {
      "commit1": "a7754b2b60f",
      "commit1_time": "2024-02-08 21:18:39 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.25261512617580595
      },
      "commit2": "0827510fd39",
      "commit2_time": "2024-02-08 21:22:04 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2736381784081459
      }
    },
    {
      "commit1": "0827510fd39",
      "commit1_time": "2024-02-08 21:22:04 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2736381784081459
      },
      "commit2": "45e7af5818f",
      "commit2_time": "2024-02-08 21:23:45 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.29955779211595657
      }
    },
    {
      "commit1": "2d474e17cb8",
      "commit1_time": "2024-02-09 02:46:11 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2987945680972189
      },
      "commit2": "930b60f5aa7",
      "commit2_time": "2024-02-09 03:55:19 +0000",
      "commit2_digest": {
        "test_eval[pyhpc_equation_of_state-cpu-jit]": 0.08685852801427245,
        "test_eval[pytorch_stargan-cpu-jit]": 0.27246096786111595,
        "test_eval[resnext50_32x4d-cpu-jit]": 0.043890661519506706,
        "test_eval[shufflenet_v2_x1_0-cpu-eager]": 0.1580003635957837,
        "test_train[tts_angular-cpu-eager]": 0.24160768394358456
      }
    }
  ]
}
```
Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/7847355330